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Monographs Acquisitions: 
Staffing Costs and the Impact 
of Automation 

Dilys E. Morris, Pamela Rebarcak, and Gordon Rowley 

In this article, the authors examine the staff costs involved in monograph 
purchases by Iowa State University (ISU) Technical Services and explore the 
impact of automation on these costs between 1990 and 1995. They demon- 
strate thai acquiring a monograph is now comparatively expensive relative 
to the costs o f cataloging. They describe the impact of staff o verhead costs 
on product or service costs and highlight the impact of professional respon- 
sibilities on costs. Tlie authors further demonstrate that, the automation of 
monographs acquisitions, in the main, has really only mechanized former 
manual processes and has done little to change the fundamental principles 
underlying the work or provide opportunities for innovation. Lastly, al- 
though cost data for collection development has not been documented, the 
authors explore the relationships between collection development and auto- 
mated acquisitions, relationships that influence costs. 



^Throughout much of the twentieth 
century the professional literature has 
presented surprisingly little relevant cost 
data about libraries. Leung (1987) noted 
that the scarcity of cost figures for catalog- 
ing was mirrored by inadequate cost data 
for all other library functions as well. 
These findings confirmed an earlier study 
by Dougherty and Leonard (1970) that 
covered the years 1876-1969. In recent 
years, however, there has been a growing 
awareness of the need for cost studies. 
Such studies have risen in importance be- 
cause they serve as relative performance 
barometers for librarians and, more im- 
portantly, because they allow for compari- 
sons over time (Leung 1987). 



Iowa State University (ISU) Technical 
Services initiated a time and cost study in 
1987 to investigate the impact of automat- 
ion on services and products. Typically, 
interest in cost studies has been sparked 
by two additional factors: heightened in- 
stitutional expectations for accountability 
and genuine fiscal restraints. Fluctuations 
in costs can reflect changes in many as- 
pects of library operations, including or- 
ganization, policies and practices, adjust- 
ments in workflow and the use of 
automation. 

Bedford (1989) suggests three key rea- 
sons for conducting cost surveys: (1) to 
provide a management tool for controlling 
the costs of technical processing func- 
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tions; (2) to manage technical processing 
functions with a progressive and dynamic 
approach; and (3) to compare cost infor- 
mation across academic research libraries 
in order to gain insights into factors that 
have direct effects on cost levels. Kantor 
(1989) also supports cost studies because of 
their usefulness for managers. In addition, 
he asserts that cost information can be used 
to justify the costs of library operations to 
those who pay the bills and to motivate both 
staff and managers into action. 

The ISU Technical Services time and 
cost study substantiates the opinions of 
others writing on the benefits of cost 
analysis. The real costs of divisional serv- 
ices are known; therefore, comparisons of 
the relative costs of different services are 
possible. A time and cost analysis reveals 
how administration, meetings, profes- 
sional service and scholarship, and other 
overhead staff costs add significantly to 
service costs. This information enables 
staff to see more clearly the costs of the 
services they deliver and to gain a better 
understanding of the cost implications of 
practices and policies. Additionally, it 
helps managers to make decisions on re- 
directing staff effort, and it allows both 
staff and management to better under- 
stand and accept the need for change. 

Organizational Structure for 
Monographs Acquisitions 

Acquisitions at ISU Technical Services is 
divided into three functional areas: serials 
acquisitions, monographs acquisitions, 
and payments. Payments staff handle both 
monographs and serials, and it is not pos- 
sible to sort costs by monographs work 
only. Therefore this analysis excludes the 
costs of activities associated with pay- 
ments for monographs. In addition, col- 
lection development responsibilities are 
in the Collections Division, and these 
costs also are not included. 

ISU Library is an unusually centralized 
system with one branch library and three 
reading rooms. Because Technical Serv- 
ices functions have never been distributed 
there is a unique opportunity to look at 
total technical service activities. No 
monographs acquisitions functions are 



delegated to branch facilities. They do 
not maintain official on-order files or 
have any responsibilities for claiming or 
reconciliation of orders. 

During the study, staff in the Mono- 
graphs Acquisitions Department handled 
all acquisitions tasks, including all order, 
receipt, and vendor functions. The only 
exception was pre-order searching. Staff 
members in the department evaluated 
vendor services and discounts, negotiated 
changes, monitored the budget, referred 
fund allocation problems, and assured ex- 
penditure of the budget. The staff in- 
volved in monographs acquisitions in- 
cluded library assistants, some students, 
and a faculty department head. Since the 
study's completion, die department head 
position was eliminated, and monographs 
acquisitions is now a unit of a larger Ac- 
quisitions Department. Pre-order search- 
ing, then and since the study, is done by 
copy catalogers in the Monographs Copy 
Cataloging Department, and the costs are 
included in the study. 

The ISU Library used the CARLYLE 
online catalog until it migrated to NOTIS 
in August 1990. Planning for NOTIS 
monograplis acquisitions implementation 
began in the 199 1-92 academic year. Firm 
orders and their payment were automated 
in July 1992, and one year later NOTIS 
monographs implementation was com- 
pleted with the addition of approvals and 
standing orders. 

In 1994-95, $1,415,000 was spent on 
monographs. Nearly 27,000 volumes and 
more than 2,000 nonbook pieces were 
purchased. Forty-one percent were re- 
ceived because of a firm order, 24% by 
approval, 21% by approval form orders, 
and 14% hy standing orders. Nearly 3,000 
monograph gifts were processed. During 
1994 an approval vendor review was con- 
ducted, and in January 1995 the Library 
changed its major domestic approval 
vendor. Work is progressing to increase 
receipts by approval. 

Methodology 

Time and Cost Sampling 

Five times each fiscal year Technical Ser- 
vices staff track all time worked for an 
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entire week. The sample weeks are spaced 
10 weeks apart. Staff record their time 
within broad product and service centers, 
and each of these cost centers is divided 
into tasks. 

Each Product and Service Center in- 
cludes all the time associated with that 
activity except meetings. Since many 
meetings are not limited to a center, all 
meeting time is collected under Support 
Activities. 

Position numbers identify staff within 
the organizational structure and allow 
sorting of data in different ways. Staff nor- 
mally complete their time sheets anony- 
mously. The data are never used for indi- 
vidual performance evaluation. 

The exact salary for each employee is 
collected for every sample week, and 
benefits are included. Hourly salaries are 
determined, and the task cost by em- 
ployee calculated. Task times and costs 
are summed and form the basis for all 
analysis. 

Production Units and Cost Analysis 

In order to determine the costs of prod- 
ucts and services, production units must 
be determined. For monographs acquisi- 
tions, total receipts are used. Receipts are 
basically a volume count. For nonbook 
material, pieces are counted, except for 
microfiche, in which case a title count is 
used to prevent inflation of production 
units. Production statistics are now sub- 
mitted for the sample week period. Prior 
to 1994-95, production units were ex- 
trapolated from monthly statistics. 

The number of items received is di- 
vided into staff costs to arrive at a cost per 
activity. In order to understand relative 
costs of the varying acquisitions activities, 
"receipts" is used as the constant pricing 
unit. This allows the following costs to be 
calculated and compared: cost per receipt 
to search orders, cost per receipt to place 
orders, cost per receipt to claim orders, 
cost per receipt to receive material, cost 
per receipt to maintain order records, cost 
per receipt to solve problems and monitor 
costs, and cost per receipt for training and 
documentation. 

In addition, the overhead center costs 



must be apportioned to the acquisitions 
tasks. These overhead costs are paid leave 
time (sick, vacation, and holidays) and 
support activities (administration, meet- 
ings, personal, professional work, etc.). 
Overhead costs can be assigned at both 
the department or unit level and for the 
entire division with varying results. The 
costs are presented in three ways: (1) cost 
of acquisitions tasks only: no overhead, 
(2) cost of acquisitions tasks with depart- 
mental overhead, and (3) cost of acquisi- 
tions tasks with divisional overhead. 

One more cost adjustment is made. 
Faculty and Professional and Scientific 
staff who work over 40 hours are not paid 
for these additional hours. Since the 
methodology calculates costs by multiply- 
ing a staff member's hours worked by her 
hourly salary, the bottom line can include 
costs not paid. A formula is used to re- 
move the unpaid "over 40" costs. In this 
analysis the two different costs are re- 
ferred to as: Costs: Hours Paid; Costs: 
Hours Worked. 

Costs are shown in the dollars paid 
during the sample weeks and also are ad- 
justed for inflation to 1994-95 dollars. 

Results 

Over the course of the five-year study, 
time spent at monographs acquisitions 
dropped by 15% (an average reduction of 
38 hours per week). By 1994-95 mono- 
graphs acquisitions tasks accounted for 
37% of the total time spent at acquisition 
functions in Technical Services. Serials 
Acquisitions accounted for 45% of the bal- 
ance and Payments for 18% (see figure 1). 

For this study monographs acquisi- 
tions tasks were combined into seven 
major functions: Searching, Ordering, 
Claiming, Receiving, Maintenance, Prob- 
lems and Costs, and Training and Docu- 
mentation. The results of each will be 
discussed separately. 

Searching 

Order searching includes determination 
of relationships between editions, loca- 
tion and transfer of OCLC cataloging re- 
cords, duplicates detection, and prelimi- 
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nary cataloging authority work (series and 
some authors). It is the third largest acqui- 
sition task, averaging 12% of the total ac- 
quisitions time and under 30 hours per 
week (see figure 2). 

Over the course of the study, the aver- 
age weekly hours dropped and productiv- 
ity increased, with the exception of 1993- 
94. An average of 16 orders an hour are 
now searched. Ten percent are not or- 
dered mostly because of duplication and 
are returned to the selector (see table 1). 

Ordering 

This task includes price and vendor deter- 
mination, NOTIS record creation, revi- 



sion and, formerly, typing order records. 
This is the second largest task averaging 
about 50 hours per week, (see figure 2). 
The time devoted to this task dropped 
greatly over the course of the study until 
the last year when orders jumped sharply 
upward, increasing more than 70%. Pro- 
ductivity increased, and currently eight 
orders an hour are placed (see table 2). 

In 1994-95 revision accounted for 
21% of the task time, price and vendor 
determination 11%, and NOTIS record 
creation the remaining time. 

Claiming 

Claiming includes correspondence for- 



TABLE 1 
Weekly Averages: Searching 



iVsu 




Orders 


Hourly 


% of 


Return 


Hours 


Searched 


Rate 


Total Time 


% 


1990/91 


42 


307 


7.5 


15.0 


16 


1991/92 


34 


253 


7.3 


14.4 


19 


1992/93 


24 


221 


13.7 


9.6 


9 


1993/94 


34 


298 


8.6 


15.0 


9 


1994/95 


28 


446 


15.9 


11.8 


10 
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^•Receiving ElOrdering tziSearching 

^Maintenance & Distribution ■ Problems & Costs ^Claiming 
Training & Documentation 






1990/91 


1991/92 


1992/93 


1993/94 


1994/95 


"Receiving 


73 


57 


81 


86 


87 


Ordering 


58 


45 


33 


36 


51 


Searching 


42 


34 


24 


34 


28 


Maintenance & Distribution 


33 


40 


31 


21 


27 


Problems & Costs 


30 


21 


33 


21 


21 


Claiming 


32 


30 


31 


24 


20 


TrslnlnD & Documentation 


9 


17 


25 


5 


4 


Total Hours 


276 


244 


258 


227 


238 


Receipts 


809* 


506 


499 


506 


475 



Figure 2. Average Weekly Hours for Monographs Acquisitions. 



mulation, NOTIS claim generation, re- 
cord updating and, Formerly, claim typing. 
Claiming is one of the smallest activities, 
requiring about 20 hours per week (9% of 
total time), and ranking sixth out of the 
seven tasks. Over the course of the study, 
its time dropped by over 30% and produc- 
tivity increased (see figure 2), 



lems, solving problems, and sorting for 
cataloging. It is the most time- consuming 
task, averaging nearly 90 hours a week, 
and accounts for 36% of monographs ac- 
quisitions time (see figure 2). Unlike the 
other tasks, it grew over the course of the 
study and productivity declined. About 6 
items are received per hour (see table 3). 



Receiving Materials 

Receiving includes opening and sorting mail, 

tures^ cLteeting and referring fund prob- 



Maintenance and Distribution 

This task includes pulling, filing, and 
clearing records, mail preparation, sort- 
ing, shelving, and distributing materials, 



TABLE 2 



Weekly Averages: Ordering 


Year 


Hours 


Orders 
Placed 


Hourly 
Rate 


% of 
Total Time 


1990/91 


58 


263 


4.6 


20.8 


1991/92 


45 


183 


4.0 


18.8 


1992/93 


33 


213 


7.0 


12.9 


1993/94 


36 


273 


7.2 


15.6 


1994/95 


51 


411 


8.1 


21.5 
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TABLE 3 








Weekly Averages: 


Receiving 










Hourly 


%o( 


Year 


Hours 


Receipts 


Rate 


Total Time 


1990/91 


73 


809 


11.0 


26.5 


1991/92 


57 


506 


9.0 


23.4 


1992/93 


81 


499 


6.4 


31.0 


1993/94 


86 


506 


6.0 


37.6 


1994/95 


87 


475 


5.6 


36.1 



functions that do not fit elsewhere. It 
ranks fourth in time, involves over 26 
hours weekly and represents 11% of total 
time (see figure 2). Its time fluctuated 
over the course of the study but did drop. 

Problems and Costs 

This task includes cost monitoring, con- 
sulting and referring on acquisitions is- 
sues, and problem-solving that requires a 
greater than normal effort. It is not rou- 
tine problem-solving. This is the third 
smallest activity, and time fluctuated over 
the course of the study (see figure 2). It 
accounts for 9% of total acquisitions time 
and around 20 hours per week. 

Training and Documentation 

This includes training time where no work 
is accomplished (e.g. the time of the 
trainer, trainee reading documentation). 
If a staff member is training while per- 
forming a task and accomplishing work, 
the time is counted in the task being 
learned. This task also includes all time for 
policy and procedure preparation. This is 
the smallest activity, representing an aver- 
age of 4 hours weekly, i.e., less than 2% of 
total time. Time in this activity declined, 
but there was major variance over the 
course of the study (see figure 2). 

Staff Costs 

In table 4, the average weekly staff costs 
over the years of the study are compared. 
It shows dollars paid during each year and 
has not been adjusted for inflation. 



It shows the average weekly cost for 
each of the seven acquisitions activities 
and provides a weekly total. As explained 
earlier, the weekly cost is presented in two 
ways: Hours Worked and Hours Paid. 

Hours Paid represents the real costs to 
the institution. Table 4 also gives the aver- 
age cost per receipt of acquiring a new 
monograph. Costs can be seen both with 
and without stalling overhead applied. In 
fiscal year 1994-95, the average cost for 
acquiring a monograph without staffing 
overhead was $7.38. If the overhead staff- 
ing costs (leave and support activities) at 
the departmental level are apportioned, 
the cost increases by 47% to $10.85. With 
the addition of divisional overhead, there 
is a further 20% price increase to $13.01 
(see table 4). 

By using receipts as the pricing unit, 
the relative 1994-95 costs of the seven 
major acquisitions activities can be com- 
pared as shown in table 5. 

Receiving is the most costly task, fol- 
lowed in descending order by Ordering, 
Searching, Problems and Costs, Claiming, 
Updating and Maintenance, and Training 
and Documentation. Costs fluctuate from 
week to week depending on the time 
spent on tasks and the average salary paid 
to do the tasks. The five weeks sampled in 
1994-95 were: 

• September 5-11 Labor Day Holiday 

• November 13-19 No meeting week 

• January 22-28 ALA Annual Meeting 

• April 1-7 

• June 10-16 

It is possible to compare staffing costs 
over the course of the study if the costs are 
adjusted for inflation as measured by the 
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TABLE 4 
Weekly Average Costs 



1990791 1991/92 1392/93 1993/94 1994/9S 







Task Costs ($) 












VIA 




1251 


1270 


Ordering 


712 


592 


449 


433 


728 


Searching 


527 


435 


334 


474 


437 


Problems/Costs 


530 


369 


610 


378 


422 


Claiming 


343 


340 


417 


318 


306 


Updating/Maintenance 


278 


414 


364 


227 


306 


Training/Documentation 


157 


310 


515 


98 


67 






Totals ($) 








Hours Worked 


3452 


3132 


3850 


3180 


3538 


Hours Paid 


3382 


3099 


3819 


3170 


3504 


Overhead Apportioned 












Departmental 


5239 


4981 


5296 


4778 


5154 


Technical Services 


6029 


5098 


6125 


5123 


6179 






Cost Per Receipt ($) 








task only 


4.18 


6.13 


7.65 


6.27 


7.38 


Overhead Apportioned 












Departmental 


6.47 


9.85 


10.61 


9.44 


10.85 


Technical Services 


7.45 


10.08 


12.27 


10.13 


13.01 






Production Statistics 








Receipts 


809 


506 


499 


506 


475 


Orders 


263 


183 


213 


273 


411 



Higher receipts in 1990/91 due to gifts. 

Higher orders in 1994/95 due to domestic Approval vendor change. 



Consumer Price Index for Urban Wage 
Earners and Clerical Workers. Figure 3 
shows that weekly costs dropped from 
$5,860 to $5,154, or 12%. That decline 
correlates to the 15% time reduction. The 
same adjustment is made for the per-re- 
ceipt cost in figure 4. 

In the analysis that follows, the cost 
with departmental overhead ($10.85 per 
receipt) will be used. 

Analysis of Results and the 
Impact of Automation 

Costs 

Over the course of the study costs 
dropped by 12% when adjusted for infla- 



tion but time dropped by 15%. While po- 
sitions were cut, there were also many 
reclassifications that raised salaries. With 
automation, the clerical tasks were elimi- 
nated and staff worked more inde- 
pendently. To use automation effectively, 
processing should be completed at first 
handling whenever possible. This re- 
quires staff to have a broader knowledge, 
work with little revision, and solve more 
problems. 

The $10.85 cost to acquire a mono- 
graph volume came as a surprise to ISU 
Technical Service!; because it is as expen- 
sive as cataloging, a cost that is being ques- 
tioned nationally. Cataloging costs are by 
title and acquisitions by volume, so com- 
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Cost per Receipt 1994-1995 










Overhead Apportioned 




Hourly 


Task 








wage 15>; 


uniy 


uepartmentai ^<p/ 




Receiving 


14.58 


2.65 


3.90 


4.67 


Ordering 


14.35 


1.52 




Z.Do 


Searching 


15.62 


.91 


1.34 


1 CI 


Problems/Costs 


19.95 


.88 


1.29 


1.56 


Claiming 


15.09 


.64 


.94 


1.13 


Updating/Maintenance 


11.50 


.66 


.94 


1.13 


Training/Documentation 


16.17 


14 


.20 


.24 


Totals 




7.38 


10.85 


13.01 


Percent increase 






47% 


76% 



parisons are a little tricky. The following 
monographs cataloging costs cover all 
cataloging, including original. 

1994-95 Cataloging Cost per Title 
Task only $6.30 
Departmental overhead 11.10 
TS overhead 11.41 

Cataloging has a lower task cost at 
$6.30 per title compared to $7.38 per vol- 
ume lor acquisitions. Cataloging has a 
higher overhead because of the higher 
percent of f aculty involved. That issue will 
be discussed later. In addition, $10.85 is 
not the entire cost of monographs acqui- 
sitions, because it excludes all staff costs 
of selecting materials as well as the costs 
of paying and maintaining audit trails. 

An acquisitions cost calculated on a 
per-receipt basis is sensitive to the total 
work environment and must be used 
with care. When adjusted for inflation, 
fiscal year 1990-91 shows the lowest 
per-receipt cost (see figure 4), but the 
highest weekly staff cost (see figure 3). 
The major factor in lowering the per-re- 
ceipt cost in 1990-91 was the number of 
gifts processed. Gifts require the least 
staff processing time, and their addition 
is not controlled by the acquisitions 



budget. Inadditionthere was anevensplit 
between approval and firm orders. Firm 
ordered materials require the most staff 
time and therefore carry a higher per-re- 
ceipt staff cost. Over the last four years 
approval receipts at ISU have dropped by 
one-half. ISU changed approval vendors 
in January 1995, and approval coverage is 
expected to increase. This is expected to 
reduce the acquisitions staff costs not only 
in technical services but also in collection 
development. 

While the lower costs of approvals can 
be deduced from the data, the ISU time 
cost study is not reliable at this level of 
specificity, primarily because the staff 
who handle approvals also handle gifts. 
During the five sample weeks of 1994-95, 
there was only one week when no gifts 
were processed. During this week only, 
comparison of costs for approval process- 
ing versus firm ordeT processing revealed 
a 40% higher processing cost for firm or- 
ders. While this sample is too limited to 
make a valid comparison, the results do 
reflect what was expected, and further- 
more, the findings are reinforced by stud- 
ies done by Stevens (1996) and by Cargill 
and Alley (1979). Another caveat worth 
remembering when making comparisons 
of this kind is that staff specialize by order 
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Cost per Week 



Receipts/Orders 



Actual Dollars 
Dollars Adjusted for Inflation 
Receipts (with gifts) 
Receipts (no gifts) 
Orders 




L 



*1 990/91 receipts high mainly due to gifts 



Actual Dollars ^Dollars Adjusted for Inflation * Receipts (with gifts) 
Receipts (no gifts) ♦Orders 



Figure 3. Weekly Cost Adjusted for Inflation. 



Cost per Receipt 



Receipts/Orders 






1990/91 


1991-92 


1992/93 


1993/94 


1994/95 


Actual Dollars 


$6.47 


$9.65 


$10.61 


$9.44 


$10.85 


Dollars Adjusted for Inflation 


$7.24 


$10.70 


$11,19 


$9.72 


$10.85 


Receipts (with gifts) 


809.3* 


506 


499 


506 


475 


Receipts (no gifts) 


548 


431 


450 


450 


415 


Orders 


263 


183 


213 


273 


411 



M990/91 receipts high mainly due to gifts 



(^Actual Dollars ^Dollars Adjusted for Inflation 
Receipts (no gifts) —Orders 



Receipts (with gifts) 



Figure 4. Cost per Receipt Adjusted for Inflation. 
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type, and there are very few staff involved. 
At this detailed level of costing, the effec- 
tiveness of individual staff members can 
shape costs significantly. 

Controlling Monographs 
Acquisitions Costs 

While librarians at ISU intend to refine 
the NOTIS implementation of mono- 
graphs acquisitions further and expect to 
push down costs, there are limitations. 
Hewitt (1989) points out that decision- 
making authority and the potential for 
self-determination are severely limited. 
He identifies four outside influences that 
impinge directly on acquisition's ability to 
meet day-to-day objectives: 

• Acquisitions goals are set by collec- 
tions development policies 

• Output standards are set by cataloging 

• Performance demands are set by users 
and public services 

• Procedural requirements are set by 

accountants and auditors 

Acquisitions staff must adapt and ac- 
commodate to the following unique oper- 
ating conditions and expectations: 

• Primary workload is determined by 
the number and types of orders placed 

• Different types of receipts can in- 
crease labor intensity (e.g., firm or- 
ders as opposed to approval orders; 
foreign as opposed to domestic) 

• Turnaround time is based on external 
factors: delivery service, vendor re- 
sponse, publisher turnaround, avail- 
ability of item 

• Fiscal calendar determines what is 
done and when 

• Perceived and real accounting prac- 
tices 

• Inadequate software applications to 
support collections fund accounting 
expectations 

Implementing automated acquisitions 
at ISU was complex for many of these 
reasons. There are many stakeholders 
throughout the library system, which 
makes it difficult to change policies and 
procedures. In addition, implementing 
NOTIS without any significant enhance- 
ments derived from local programming 
presented a rather inflexible system for 



handling monographs acquisitions. Fi- 
nally, the need for fiscal control and an 
audit trail limited experimentation. Thus 
implementation with slight variation 
mimicked the manual system. In compari- 
son, when cataloging was first automated 
in 1977 with the introduction of OCLC, it 
was an activity completely controlled by 
Technical Services. This made it possible 
to revamp the entire workflow to optimize 
the use of an online system. Over the 
intervening years, continuing local refine- 
ment and national developments helped 
reduce cataloging costs. 

Fund Accounting 

As Phelps (1991, 35) has pointed out, "one 
of the problems in attempting to analyze 
the financial impact on technical process- 
ing of an integrated online system is the 
fact that the system both saves and adds 
costs." When the process involves library 
staff beyond technical services such as col- 
lection development, the potential for 
cast trade-off's is even greater. This be- 
came evident soon after ISU imple- 
mented the NOTIS acquisitions module. 
In order to accommodate system require- 
ments a new process had to be devised for 
transferring money among the funds for 
purchasing monographs. 

The fund structure developed inter- 
nally for handling monographic purchases 
with the new automated system very 
closely resembled the previous one be- 
cause Collection Development staff were 
familiar with that approach. The new fund 
names, their codes, and designations for 
types of monographic order — direct or 
firm orders, approvals, and monographic 
continuations — were already familiar and 
reduced the need for staff training. Nev- 
ertheless, the application of this design to 
fund management in the automated envi- 
ronment revealed that the system lacked 
flexibility as compared to the existing pro- 
cedures. The automated acquisitions sys- 
tem does not allow expenditure or com- 
mitment of funds from an account when 
there is insufficient balance to support the 
transaction. Hence, funds now had to be 
transferred from one account to another 
in order to prevent the automated system 
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from refusing to process an order or re- 
ceive a volume against an account that was 
already very heavily spent or encumbered. 
A procedure for interfund transfers was 
developed to enable Collection Develop- 
ment librarians (fund managers) and ac- 
quisitions staff to release orders and re- 
ceive new material and for payments staff 
to track these transfers on the new system. 

The procedure described above for 
initiating and tracking interfund transfers 
added new steps to the workflow, both in 
Technical Services and Collection Devel- 
opment. Sometimes these transfers in- 
volved more than one fund manager, but 
often a fund manager needed to move 
money from one fund under her purview 
to another for which she was also respon- 
sible. Yet in so doing, other staff became 
involved in order to track this activity in 
the automated system. For example, a se- 
lector might need to move money from 
her monographic firm order account to 
the corresponding approval account or 
vice versa. Although each task involved in 
this new procedure was not tracked for 
the purposes of this study, an analysis of 
the activity during the first three fiscal 
years in which this new interfund transfer 
procedure was available suggests that it is 
a new cost factor. 

During the first fiscal period in which 
orders for monographs were processed 

of the money tracked on the system was 
involved in an interfund transfer; during 
the second year this increased to 26.2%, 
and by the end of the third year just under 
one-third (33.2%) of the money handled 
on NOTIS for monographic purchases 
had also been included in an interfund 
transfer. Further analysis shows that in 
each of the three years the largest amount 
of money was transferred from approval 
lines to monographic firm order accounts; 
these data support conclusions also drawn 
from the cost -study analysis about the in- 
crease in firm order activity. Interestingly, 
many fund managers had to transfer funds 
among their own accounts. By the third 
year for which data were available, 12.4% 
of the interfund transfers represented ac- 
tivity among accounts managed by the 
same collection development librarian. 



Not only do these data suggest budget 
planning issues to be explored, they also 
represent a new real cost to the library for 
carrying out this work. 

Fund accounting formerly was sepa- 
rate from the acquisition tasks, done as an 
end process in the Library Business Of- 
fice. Over-spending within fund accounts 
occurred because the system did not pre- 
vent it. Since fund accounting now occurs 
before an order can be placed or a book 
received, inadequate funds in an account 
stops the acquisition process. The inter- 
ruption not only increases handling costs 
but also slows the acquisition process. 

Searching 

As noted before, Technical Services order 
searching includes detection of dupli- 
cates, determination of relationships be- 
tween editions, location and transfer of 
OCLC records to supply bibliographic de- 
scriptions for order records, and some 
preliminary authority work. In 1992-93 
the number of duplicates found during 
Technical Services pre-order searching 
declined dramatically (see table 1). Two 
main factors influenced this reduction: 
changes to the withdraw and replace pro- 
cedures, and the implementation of auto- 
mated acquisitions. Automated acquisi- 
tions speeds entry of order requests into 
the online system and allows remote 
checking. Both features assist selection 
work and reduce wasted time in generat- 
ing unneeded order requests. 

In 1994-95 order searching prevented 
the unnecessary ordering of an estimated 
2,000 monographs and the later work of 
handling unwanted titles. It prevented the 
expenditure of an estimated $12,000 in 
staff costs to order and receive these titles . 
In addition the precataloging work com- 
pleted during pre-order searching speeds 
the cataloging process upon receipt. 

At ISU, selectors still generate a paper 
order request that must be entered into 
the system. Acquisitions systems that 
automate order requests at the point of 
selection will reduce unnecessary work 
and assist selectors and users. Recent ISU 
studies demonstrate that slightly over 
90% of the order requests have an OCLC 
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record to transfer into the NOTIS system 
at the time of order searching. 

Online acquisitions increased the 
number of orders searched per hour, and 
thus, the cost of order searching declined. 
The ISU data show a puzzling drop in 
productivity during 1993-94. All investi- 
gation has failed at determining the cause. 

Ordering 

With automation, the effectiveness of or- 
dering increased dramatically as demon- 
strated by the increase in the hourly order 
rate (see table 2). The use of OCLC cata- 
loging records to create order records re- 
duced the order creation time and im- 
proved accuracy. As noted, over 90% of 
the monographs ordered in 1994-95 had 
an OCLC cataloging record at the point of 
pre-order search. Order placement ac- 
counts for 20. 7% of total costs, with 12.2% 
being the actual NOTIS record creation, 
5% revision and 3% price and vendor de- 
termination. As expected, revision time 
dropped dramatically in the automated 
environment. In the year preceding auto- 
mation 12 orders were placed for every 
hour of revision. By 1994-95, 57 orders 
were placed for every hour of revision. 

Receiving 

Receiving accounts for 35% of the total 
cost of acquiring a monograph. In the year 
preceding automation, with receipts 
slightly higher, receiving accounted for 
only 23% of the cost. This dramatic in- 
crease was a surprise, but understandable 
once analyzed. The analysis identified 
work transferred to receiving and bottle- 
necks in the online environment. 

Problem-solving during receiving has 
grown as has the referral of materials to 
selectors. Both factors stop the receiving 
activity and increase handling. Biblio- 
graphic problems identified in receiving 
used to be corrected later by catalogers, 
but automated acquisitions requires ear- 
lier problem resolution. Changes in pro- 
cedures unrelated to automation also in- 
crease handling. Selectors no longer 
automatically review all approval form se- 



lections when received, and their requests 
to see individual titles upon receipt have 
increased. As noted earlier, automated 
fund accounting as implemented at ISU 
complicates and delays receiving and in- 
creases the work of selectors as well. Re- 
ceiving functions require review to deter- 
mine how greater efficiency can be 
achieved. 

More items are received on each in- 
voice now. This reduces the number of 
vouchers produced, added, assembled, 
and signed (and the number of invoices 
created). There is a cost savings for the 
Treasurer's Office when fewer checks 
need to be cut. 

Claiming 

Claiming continued to be a variable activ- 
ity after automation, with time varying 
substantially from week to week. With 
automation it became a less labor inten- 
sive activity (see figure 2) as well as an 
enormously more productive activity. The 
number of claims sent increased by over 
100% after automation. 

Maintenance and Distribution 

As expected, automation dramatically 
changed record maintenance activities. 
The time spent filing and pulling records 
dropped from 14 hours a week to 2. This 
type of dramatic reduction in clerical ac- 
tivities changed the nature of job descrip- 
tions and the assignment of tasks. The 
time spent at mail preparation and mate- 
rial sorting, shelving, and distribution 
showed no change. 

Problems and Costs 

Problem resolution and costs, primarily 
handled by the most qualified staff, has 
the highest hourly cost. Over the course 
of the study the time spent monitoring 
costs remained fairly constant. Motb time 
was spent in 1994-95 because of the 
change in approval vendors and the asso- 
ciated cost analysis. While problem solv- 
ing and consulting time dropped, this de- 
crease appears to have resulted from a 
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change in management practice rather 
than automation. During the first year of 
NOTIS implementation, there was a strik- 
ing increase in problem solving and con- 
sulting. 

Training and Documentation 

NOTIS implementation initially in- 
creased the time spent at these tasks. The 
year before and the year after implemen- 
tation saw a large increase in time, but 
afterwards training and documentation 
decreased. Since automating, the clerical 
level positions were eliminated and staff 
were reclassified to higher levels. Higher 
level staff traditionally show lower turn- 
over rates and thus training time declines. 

Relative Task Costs 

While the bottom line cost per receipt 
varied among weeks, the relative costs of 
the seven activities is quite consistent. 
During all five weeks receiving was always 
the most expensive task per receipt, and 
training, the least expensive. Ordering 
was the second most expensive task in 4 of 
the 5 weeks sampled. The task with the 
greatest variance was problems and costs. 
During the week when meetings were at 
a minimum, the lowest per-receipt costs 
were achieved. 

In every year, receiving was the most 
expensive task. The first year of NOTIS 
implementation, 1992-93, shows the 
greatest fluctuation from the norm. Train- 
ing and documentation grew to the third 
most costly activity from its normal bot- 
tom ranking. Solving problems and cost- 
ing rose to the second ranking from its 
lower rankings. In 1991-92 maintenance 
rose from sixth to fourth, indicating the 
preparation and clean-up work necessary 
for automation. 

Overhead Staff Costs 

Overhead staff costs (leave and support 
activities) are not unique to monographs 
acquisitions or technical services. They 
exist in every part of an organization. It is 
an important cost to examine when evalu- 



ating how to reduce costs. In 1994-95 
departmental overhead raised the cost of 
monographs acquisitions by 47%. When 
the entire divisional overhead costs are 
applied, the costs increased by 76% (see 
table 4). 

In figure 5, overhead costs for all of 
Technical Services are presented. Product 
and service centers represent 56.8% of 
Technical Services labor costs (acquisi- 
tions, cataloging, catalog maintenance, 
volume processing, conversion, automat- 
ion), while overhead centers are 43.2% 
(leave 14.8%, support activities 28.4%). 
Figure 6 shows the same data for the two 
departments used in this study (Mono- 
graphs Acquisitions and Monographs 
Copy Cataloging). 

Leave is a cost area over which an 
institution has little control. Although one 
might assume that the cost for support 
activities could be easily reduced because 
an institution has considerable control 
over them, achieving this is difficult. ISU 
Technical Services has attempted to re- 
duce these costs, but with limited success. 
Administrative costs have dropped due to 
reductions in administrative positions. 
However, the drop in administrative costs 
has not been as steep as the drop in posi- 
tions, reflecting the fact that tasks are be- 
ing reassigned to non -administrative staff 
rather than eliminated. Meeting time has 
also increased, except for 1992-93 when 
"No M eeting Week" was introduced. With 
fewer administrative positions, there is a 
greater emphasis on team management 
and thus more meetings. 

ISU librarians have faculty status, with 
major expectations for research and schol- 
arship and professional service. Over the 
course of the study, there was no reduc- 
tion in professional activities even though 
Technical Services faculty positions 
dropped by 25% (from 16 to 12 positions). 
Faculty expectations, in fact, increased 
during the study period, and this phe- 
nomenon is clearly revealed by the data. 
Fewer people are spending more time at 
professional activities. When determining 
costs, anything done by faculty is very 
expensive, because of the heavy profes- 
sional, service, and publication expecta- 
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Figure 6. Departmental Weekly Average Costs, 1994r-95. 



tions. The time spent on these activities 
must be included in their direct service or 
product costs. For example, original cata- 
loged, who are faculty, spend only 39% of 
their time cataloging. The remainder of 
their time must be calculated as overhead 
costs, which in 1994-95 increased the cost 
of original cataloging for a monograph by 
170%. The higher cataloging overhead 
costs as compared to acquisitions over- 
head show the impact of staffing levels on 
costs. 

Another growth area, general reading, 
applies to an ever increasing number of 



staff. It is necessary to keep abreast of the 
rapid changes in information technology. 
At the beginning of the study, general 
reading accounted for 2.4% of total Tech- 
nical Services costs. It grew to 3.4% by 
1994-95. 

With the automation of acquisitions 
completed and with greateT authority and 
responsibility invested in higher classified 
staff, the Serials and Monographs Acqui- 
sitions departments were merged and a 
department head position eliminated in 
January 1996. This will lower overhead 
costs. 
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Future Implications 

Beyond Mechanized 
Manual Processes 

This study reveals that ISU Technical 
Services incurs considerable staff costs 
when it acquires a monograph. In fact, 
the full costs of acquisitions are not re- 
flected in this study, since all selection, 
payment, and audit trail staff costs were 
excluded. 

Automated acquisitions has mecha- 
nized formerly manual processes. It has 
taken past practices and allowed them to 
be performed better and faster, but the 
tasks themselves have remained virtually 
unchanged. Most of the automated en- 
hancements support acquisition tasks. 
For selectors automation has done little 
more than improve the precision of finan- 
cial information and provide immediate 
status information. It is time to move on 
to the second stage of technology adapta- 
tion, in which technology revises what is 
done, and things never done before be- 
come possible. 

Developers of integrated library sys- 
tems need to give greater attention to 
both the selection and the acquisition 
processes. Circulation and interlibrary 
borrowing data should be readily available 
in meaningful reports to support collec- 
tion development. Library systems should 
allow the smooth transfer of information 
from users through the library selection 
and acquisition processes to vendors. 

If acquisitions is to move to the second 
stage of technological adaptation, local 
system enhancements are not sufficient. 
Bibliographic utilities, book vendors, and 
librarians need to forge alliances to en- 
hance cooperative activities and reduce 
duplicative activities; such a process 
would be similar to what has happened 
with cataloging. 

Can bibliographic utilities and vendors 
develop new products that change local 
selection responsibilities? Is it possible for 
selection to become a more cooperative 
activity between vendors and biblio- 
graphic utilities, with local review varying 
according to local requirements? Is it pos- 
sible to profile the automatic receipt of 



most materials so collection development 
can focus on newly emerging areas and on 
maintaining collections where a univer- 
sity's mission requires uniqueness or un- 
usual breadth? Can bibliographic utilities 
and vendors working together develop se- 
lection profiles based on university pro- 
grams? Can local acquisitions patterns be 
compared by disciplines to other institu- 
tions and to publishing output? 

Need for Restructuring 

Rowley and Black (1996, 23) point out 
that while changing scholarly communica- 
tions is having a major impact on the col- 
lection development mission, "collection 
development is one of the least addressed 
and yet highly critical areas in designing 
the future of information management 
and access." Their analysis shows that in 
most ARL libraries, collection develop- 
ment has changed little since the 1970s. 
While the authors find greater reliance 
upon technology and refinement of work 
at the task level, they explain that "refine- 
ments at the task level fall short of the 
restructuring required to support an effi- 
cient and effective response to the chal- 
lenges ahead." The analysis of automated 
acquisitions at ISU corroborates these 
findings. 

Could the acquisitions process and re- 
sponsibilities be restructured, as Rowley 
and Black suggest, so that professional 
staff can "take on a greater role in the 
production of knowledge, at times con- 
tributing to the design of information 
products and other times functioning as a 
publisher or distributor" (p. 27)? Selection 
duties are almost exclusively a profes- 
sional responsibility, as cataloging once 
was. The ISU data demonstrate the high 
overhead costs associated with profes- 
sional staff. If cooperation could forge 
new tools to support a more automated 
selection process, could review of receipts 
be delegated to a different level of staff, 
similar to the evolution of copy catalog- 
ing? If this were possible, professional col- 
lection development skills could be chan- 
neled to new areas resulting from the 
change in scholarly communications. 
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The "Stanford University Libraries 
Redesign Report: Redesigning the Acqui- 
sitions-to-Access Process" (1995) de- 
scribes a major restructuring, and it will 
be important to analyze the results. This 
major undertaking is focused on Technical 
Services and does not appear to include 
the selection process. The redesign does 
forge broader alliances with vendors to 
increase efficiencies and is seeking 
greater assistance from bibliographic 
utilities in the provision of cataloging 
copy. 

While the Stanford redesign effort 
concentrates on technical services, Sasse 
and Smith (1992), in their presentation at 
the 1991 Feather River Institute, exam- 
ined the entire acquisitions process from 
selection through receipt. They pointed 
out the need for a bibliographers work- 
station that would pull together local data 
and link selectors to external vendors and 
networks. They identified the opportunity 
for more mechanization of selection and 
new roles for collection developers, in- 
cluding user needs evaluation and a more 
active role in the creation of information. 



Strengthening Cost Analysis as a 
Management Tool 

The ISU experience corroborates the 
opinions of Kantor (1989), Bedford 
(1989), Leung (1989), and others con- 
cerning the role that time and cost analysis 
can play in making important manage- 
ment decisions. While it is important to 
look at library effectiveness based on cost 
studies, the power of this management 
tool would be strengthened with more 
knowledge of user needs and behavior. In 
order to determine whether a service war- 
rants the cost of providing it, more must 
be known about how users value the serv- 
ice. As automation reduces. staff contact 
with users, encourages new user groups, 
and speeds the pace of change, new user 
needs and behavior emerge. Librarians 
have relied too long on impressions of 
users' needs based on service contacts. "It 
would clearly be in the best interests of 
the users of libraries and of librarians if 



the findings of research could become a 
larger and more visible element in the 
decisions we make in managing libraries" 
(Hewitt 1983, 131). In addition, Fenni- 
man (1990) emphasizes the importance of 
costs and benefits to decision makers and 
notes that the libraries that compete less 
well, in either the private or public sector, 
are those "least prepared to express their 
value and contributions in terms under- 
stood by the their hinders" (p.ll). 

Taylor (1986) examines the addition 
and assessment of value in the entire in- 
formation arena. He sees information sys- 
tems as formal processes encompassing 
both technology and people who add 
value to information. In his view, the total 
cost of the information process includes 
both the cost of providing information to 
the user and the cost of using the informa- 
tion provided. While acknowledging the 
overs implification, Taylor believes gener- 
ally that as information provision costs go 
down (e.g. library costs), user costs go up. 
The value-added approach emphasizes 
the need to look at user benefits and costs. 
The library acquisition process is a major 
component of providing information to 
users. Determining whether the cost is 
worth the value requires a better under- 
standing of how the selection process pro- 
vides what users need and to what degree 
that process gives the user the ability to 
access information in a timely manner. 

Conclusion 

The time and cost analysis at ISU sheds 
much light on the implementation of NO- 
TIS monographs acquisitions, gives new 
insight into relative acquisition costs, and 
identifies policies and procedures that 
need further review. The study shows that 
following automation, staff time for 
monographs acquisitions dropped more 
than costs. The results are being used to 
understand the costs, to identify how they 
have changed, and to analyze workflow to 
reduce costs further. This analysis shows 
that automation can both save and add 
costs; however, the overall effect has been 
cost reduction and improved services. 
We discovered very high technical 
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services staff costs involved in acquiring a 
monograph. We also found an automated 
environment that greatly mimics the for- 
mer manual system with little opportunity 
for reductions in the Collection Develop- 
ment workload. Changing the acquisitions 
process has proven difficult because of the 
number of stakeholders involved and be- 
cause of limitations of the automated sys- 
tem. Considering the significant addi- 
tional costs of selection, payments, and 
audit records, monographs acquisitions is 
a more costly activity than cataloging. ISU 
acquisitions costs are probably similar to 
the acquisitions costs of many research 
libraries. Those libraries with more so- 
phisticated acquisition systems or the pro- 
gramming support to enhance the NOTIS 
system probably are operating more effec- 
tively. 

Since the library community and the 
book industry are clearly in the process of 
redefining their products, services, and 
procedures, tracking changes in opera- 
tional costs becomes even more critical. 
Additionally, time and cost studies will 
assist the private sector in addressing both 
market needs and business opportunities 
more effectively. Just as the costs of cata- 
loging were reduced by national coopera- 
tion, acquisitions requires more integra- 
tion with bibliographic utilities, local 
systems, and vendors. This type of study 
will help us work together to reduce du- 
plication further, lower staff costs, and 
find new ways to approach monographs 
acquisitions. 

It is evident that to this point the 
monographs acquisition process has only 
been mechanized, and the tasks them- 
selves have really not been altered in any 
meaningful way. We have simply im- 
proved the way we perform the same jobs. 
Future automation developments, in con- 
junction with restructuring, should sup- 
port evaluation of what we do, rather than 
how we do it, and provide the opportunity 
to do things never done before. In addi- 
tion to automating operations and doing 
new things, librarians must do a better job 
of evaluating the services provided and be 
able to articulate the value of those serv- 
ices. 
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A Study of Cutter Number 
Adjustment at the Ohio State 
University Libraries 

Magda El-Sherbini and John C. Stalker 



The authors conducted a study of cuttering practice at Ohio State University 
Libraries to determine the extent of effort presently devoted to the practice 
and to suggest changes that tvould result in less work without adversely 
affecting the public. They determined that there would be little deleterious 
effect if cuttering, were limited to classes M,N,andP,i 
would he halved. 



JL he assignment and adjustment of cut- 
ter numbers requires a substantial com- 
mitment of resources in copy cataloging. 
A recent OCLC Online Computer Li- 
brary Center, Inc. (1994-1995, 4) re- 
search project report notes, "Cuttering is 
an expensive, time-consuming, and error- 
prone operation, and has never received 
as much intellectual attention as classifi- 
cation. For copy cataloging, the cutter 
number is the only item in the biblio- 
graphic record that routinely requires ad- 
justment to ensure that the call number is 
unique and fits into the local shelf list. In 
many instances, except for cuttering, re- 
cords could be automatically downloaded 
into the local system without manual proc- 
essing." OCLC's research aims at develop- 
ing an acceptable algorithm for automatic 
cuttering. Expert systems have also been 
suggested to help with cuttering (Draben- 
stott, Riester, and Dede 1992). 

The Ohio State University (OSU) Li- 
braries share this burden of adjusting cut- 
ter numbers in copy cataloging. In May 
1995 library staff conducted a survey and 



analysis of cutter number adjustments to 
determine their extent and nature. Staff 
also explored whether changes could be 
proposed to lessen the burden without 
defeating the purposes of book number 
assignment and providing a unique call 
number, all while minimizing deleterious 
effects on whatever other purposes cutter 
numbers might serve. 

Historical Background 

Book numbers became an important issue 
in the 1870s. Two lengthy studies of book 
numbers appeared in the early 1980s 
(Lehnus 1980; Comaromi 1981). Barden 
(1937) provides an excellent, brief history 
of early developments. Direct patron ac- 
cess to collections and the development of 
"close classification" to arrange books on 
library shelves made book numbers nec- 
essary to provide an arrangement within 
ultimate subclasses. Charles A. Cutter 
(1878), Melvil Dewey (1879), John Ed- 
mands ("Plan for Numbering," 1878, 38) 
and Jacob Schwartz (1878) all contributed 



Magda El-Sherbini (melsher@magnus.acs.ohio-state.edu) is Head of Cataloging and John C. 
Stalker (stalker.l@osu.edu) is Head of Information Services, Ohio State University Libraries, 
Columbus. Manuscript received May 7, 1996; accepted for publication July 8, 1996. 



320/ LRTS • 40(4) • El-Sherbini and Stalker 



to the early development of book num- 
bers. Library Journal published a sympo- 
sium titled "A Plan for Numbering" 
(1879). Jacob Schwartz, the librarian at 
the New York Apprentices' Library, devel- 
oped the idea of mapping authors' names 
into numbers, and Cutter, Dewey, and 
Edmands contributed ideas and sugges- 
tions that resulted in the form of book 
number — a letter followed by a series of 
digits — now familiar to us as the cutter 
number. 

Dewey originally preferred arrange- 
ment within ultimate subclass by date of 
accession, and W. S. Biscoe (1885), librar- 
ian at Columbia, urged a chronological 
arrangement at the Lake George ALA 
conference in 1885. His date-letters later 
found their way into Cutter's Expansive 
Classification and Dewey's Decimal Clas- 
sification. Cutter realized that later addi- 
tions to the collection might make strict 
adherence to alphabetical order difficult 
to maintain without considerable effort or 
lengthy numbers. In that case, he wrote, 
"either the names can be renumbered . . . 
or the precise alphabetical order can be 
disregarded. As very great accuracy is in 
this matter of little account, the latter 
course would generally be best." How- 
ever, the distinction between the class 
number and the cutter number became 
blurred in some cases in order to provide 
an alphabetical list of subtopics, to enable 
autobiographies to precede biographies, 
to have translations follow originals, and 
for other purposes. Moreover, in an effort 
to make cutter numbers as brief as possi- 
ble, the same author's name may be rep- 
resented by different or fewer digits in a 
sparsely populated class than in a crowded 
class. Therefore, no simple formula can 
map an author's name into a number. 

Because of the effort required to pre- 
serve shelflist order, Tomfinson (1932, 
292) remarked, concurrently with Brown 
(1932), that "a veritable epidemic of li- 
braries ... do not use the Cutter book 
number" in order to achieve savings of 
time and effort in the workroom. She fur- 
ther asked, "Are cutter numbers 
doomed?" For large libraries, she noted 
that the time and effort saved in the work- 
room might be shifted to patrons and 



shelvers. Therefore, librarians at the OSU 
libraries decided to measure the amount 
of time and effort dedicated to maintain- 
ing a strict order of cutter numbers in 
order to determine whether changes in 
current practice could decrease that time 
and effort. 

The Committee Charge 

The Cataloging Policy Advisory Council 
(CPAC) was charged with studying exist- 
ing copy cataloging procedures to assess 
whether it was feasible to eliminate the 
review and adjustment of cutter num- 
bers in producing copy cataloging re- 
cords. A change in this procedure might 
reduce processing costs and improve pro- 
ductivity. 

Methods 

CPAC produced a list of questions that 
was sent to the Cataloging Policy Board 
(CPB). CPB devised a survey and asked 
the head of Copy Cataloging to gather 
data on monographic records over a one- 
week period. 

Information gathered in the survey can 
be grouped into four general categories: 

1. Class, language, date of publication, 
location, record type, or record level 
in which the cutter number was ad- 
justed 

2. Presence of cutter number 

3. Type of cutter number 

4. Reason for adjusting cutter number 
A total of 1,046 survey sheets were 

gathered, and survey results were loaded 
into an Excel spreadsheet. The SAS statis- 
tical package was used to analyze the data 
and produce statistical tables. 

Background on the Existing 
OSUL Shelfusting Policy 

The current call number policy for 
shelfusting is to review all call numbers 
both to verify their uniqueness and proper 
fit in the alphabetical order and to apply 
local practices. 

It is assumed that it is important to 
keep the call numbers unique. Only strict 
alphabetical order under main entry on 
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the shelves is in question and requires 
study. Local practices should be identified 
and compared with national standards and 
practices. If the two differ substantially, 
then the value of the local practices should 
be assessed. 

Some examples of the differences be- 
tween local and national practices are 
listed below. 

Translations 

Currendy, whenever the Library of Con- 
gress (LC) does not provide a special 
scheme for translations, librarians at 
OSUL follow their own scheme. In the 
book Midaq Alley by Najib Mahfuz, for 
example, the cutter number for the trans- 
lation from Arabic to English was changed 
in the OCLC record from OCLC PJ7846 
A46 Z4813 to OSUL PJ7846 A46 Z481. 

Biographies and Autobiographies 

OSUL policy for items for which LC slides 
the second cutter is to follow what is al- 
ready established in the shelflist. In most 
cases this requires the addition of a third 
cutter for main entry, but a few places in 
the shelflist follow LC and use the sliding 
second cutter. If nothing has yet been 
established in the shelflist, OSUL policy 
is to add the third cutter. For example, in 
class P, where tables Villa and IXa apply, 
OSUL prefers Z5 for autobiography and 
Z8 for biography and criticism. If there 
are several autobiographies, Z52, Z53, etc. 
are used. Z8 is followed by a cutter num- 
ber for author of the biography or criti- 
cism. For example, the cutter number in 
the OCLC record for a biographical work 
on James Albert Michener was changed 
from OCLC PS 3525 119 Z73 to OSUL 
PS3525 119 Z8 C5. 

In this case the cutter number Z73 in 
the OCLC record was changed to Z8 with 
a third cutter, C5, added for the author of 
the biography. 

Criticism 

It is OSUL practice to add "18" to the 
cutter number for works of literary criti- 
cism. For example, the cutter number of 



In Search of Centennial: A Journey with 
James A. Michener by John Kings was 
changed from OCLC PS3525 119 C434 to 
OSUL PS3525 119 C418. 

Selections 

It is OSUL local practice to add "17" to 
the cutter number if the book is an 
author's selected works. For example: the 
cutter number of the Selected Works of 
Henry Louis Mencken was changed from 
OCLC PS3524 E43 P912 to OSUL 
PS3524 E43 P817. 

The Study 

Distribution and Characteristics 
of the Sample 

A careful look at the tables of distribution 
and characteristics of the sample reveals 
that the sample is representative of the 
entire population of books cataloged in a 
year. The sample includes books from all 
languages, in all location libraries, dates of 
publication, and sources of cataloging 
(e.g., LC, member copy, etc.). 

Analysis of the Data 

As mentioned before, the size of the one- 
week sample was 1,046 records. The sta- 
tistics indicate that there were 694 records 
(66.34%) that fit the shelflist with no ad- 
justment to the cutter number. Two hun- 
dred eighty-eight records (27.53%) were 
adjusted to fit the shelflist alphabetical 
order, and 64 records (6.11%) were adjusted 
to fit OSUL local cataloging practices. 

In analyzing these data, six questions 
were addressed on the distribution of 
changes and additions to the cutter. If the 
cutter number were no longer adjusted, 
we wanted to see what particular areas 
would be affected and what exceptions 
needed to be considered. 

To What Extent Was the Cutter 
Adjusted in Various Classes and 
What Was Adjusted? 

The range of adjustment in the main entry 
was between 5% and 55%. In most classes, 
the cutter was adjusted to fit the shelflist 
alphabetical order. However in class P, 
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Figure 1. Cutter Adjustment by LC Class 



especially PC, PL, PN, PQ, PR, and PS, 
most of the adjustments occurred because 
of OSUL local practices. These adjust- 
ments follow the OSUL translation tables 
and add the third cutter, the criticism, or 
the biography number. There were no ma- 
jor adjustments in the personal, geo- 
graphical, and topical cutter except in 
class P, where the above adjustments were 
made (see figure 1). 

To What Extent Was the Cutter 
Adjusted for Different Languages 
and What Was Adjusted? 

The changes occurred across all languages 
without focusing on a particular language. 
The range of changes in the main-entry 
cutter was from 3% to 55%. Most of the 
changes were made to follow OSUL local 
practice. For example, in English-lan- 
guage records, 23% were adjusted to add 
the translation, third cutter, biography, or 
criticism number. 

In Chinese-language materials, 55% 
were adjusted because the LC classifica- 
tion was modified frequently. As a result, 
adjustment was made to group materials 
together under the same subject headings 
with the established classification number 
(personal headings, geographic, and topi- 
cal headings). Another reason is that for 
many Chinese materials, the main entry 
starts with the letters Ch. This requires 
consultation of the shelflist to fit the cut- 
ter number. About 50% of the Chinese 
records required cutter adjustment be- 
cause they were based on member copy, 
with various local cutter practices. The 



same applied to Japanese-language mate- 
rials, for which 24% of the records were 
adjusted to accommodate local practices 
and proper order. 

The remaining cutter changes oc- 
curred to fit the shelflist alphabetical or- 
der. In terms of geographical and topical 
cutters, there were no major changes or 
additions to the cutter number except to 
fit the shelflist alphabetical order. 

For Which Imprint Dates Was the 
Cutter Adjusted and What Was 
Adjusted? 

Proportionally, older materials (e.g., those 
printed before 1979) require more adjust- 
ment than post-1990 imprints. For exam- 
ple, in materials dated before 1979, ad- 
justments occurred in 43% of the records. 
In examining these records, we discov- 
ered that the majority of them were in 
English, in class PS, and for the TRI 
(Theater Research Institute) library. In 
post-1979 materials, adjustments were 
made in 57% of the records cataloged in 
this sample. Most of the adjustments in 
these records occurred without focusing 
on particular locations, classes, or lan- 
guages. 

We found that no major changes were 
made in topical and geographical cutter in 
any date of imprint (see figure 2). 

To What Extent Was the Cutter 
Adjusted for Different Locations 
and What Was Adjusted? 

Changes in the cutter happened across all 
location libraries. The range of changes in 




Figure 2. Percentage Adjusted by Date of Work 
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the main cutter was 4% to 80%. Some 
locations required many changes. For ex- 
ample, changes were made to 80% of rec- 
ords for the books housed in the East 
Asian Studies, for the reasons stated 
above. 

The second-highest percentage of 
changes (78%) occurred in records for 
items located in the TRI library. One rea- 
son for these changes is that many items 
cataloged for TRI are plays, which fall into 
the literature category, in which the cutter 
number is frequendy adjusted to fit 
OSUL local practice. 

Another reason for frequent cutter 
changes is the age of materials. Because 
many of the TRI materials are old and 
were cataloged much earlier, existing 
cataloging records call for modification of 
the cutter number to fit the shelflist order. 
For example, a cutter number of a play by 
Mabel Margaret Cowie Clark was 
changed on the OCLC record from 
OCLC PR6005 L32 H4 to OSUL PR6005 
L36 H4. The reason for changing the 
author number is that the author number 
was established earlier at the OSUL 
shelflist as L36. This practice explains why 
the percentages of adjusting the cutter 
number in class PS (47%) in the personal 
cutter and in the pre-1979 (43%) books 
were relatively high. 

The third-highest percentage of changes 
occurred in materials for the Map room. 
One reason is that most of the cutter num- 
bers for map records had single digits; to 
make room for additional digits, the cutter 
number was expanded. For example, the 
cutter number of one map was changed 
from OCLC G876 L3 to OSUL G876 L34. 
In this case the cutter number fit the 
shelflist order, but another digit (4) was 
added to expand the cutter number for 
future titles starting with the letter L. 

In 50% of the books housed in the 
music library, the cutter number was 
changed. One reason was that in the past, 
in addition to the composer number, the 
cataloging department used another cut- 
ter for the title of the book. Shelflisting 
policy later changed and no longer re- 
quired use of the second cutter. This had 
an adverse impact on the shelflisting pro- 
cess, requiring fitting a single cutter into 
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a double cutter number. No major 
changes were needed for the geographic 
and the topical cutter number (see fig- 
ure 3). 

In Which Record Types Was the 
Cutter Adjusted and What Was 
Adjusted? 

Record source tables indicate that the 
most changes in cutter number were 
made for records supplied by member 
libraries (29%) followed by records pro- 
vided by LC (17%). There were no major 
changes in the geographic and topical cut- 
ter number. 

To What Extent Was the Cutter 
Adjusted for Different Record 
Levels and What Was Adjusted? 

There were changes in all record levels, 
but records that are encoded as levels L 
(which is atapeload from RLIN to OCLC) 
and 7 (which is minimum-level cataloging 
done by LC) had the most changes in the 
cutter number (33%). These were done to 
fit the shelflist order. Changes to records 
encoded level I (full LC record) were 
done to follow local practice. 

Some General Observations 
and Summary 

In the sample, the cutter numbers in 694 
records (66%) were accepted as is. In 288 
records (27.53%), the cutter numbers 
were adjusted to fit the shelflist alphabeti- 
cal order, and in 64 records (6.11%) the 
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cutter numbers were adjusted to fit OSUL 
local practices. The following paragraphs 
will provide some explanation and exam- 
ples of two types of change. 

Changing Cutter to Fit the 
Shelflist Order 

As mentioned before, adjustments to the 
cutter numbers occurred in 288 records 
across class, language, location, and level 
of cataloging. These cutters were adjusted 
to keep the books on the shelves in alpha- 
betical order and to facilitate browsing by 
patrons. 

Some examples of changing the cutter 
to fit the shelflist alphabetical order are: 



OCLC 

LB 2825 B428 
LB 2825 B434 
LB2825 B44 
LB 2825 B55 
LB 2825 B678 
LB 2825 B722 



OSUL 

LB 2825 B39 
LB 2825 B4 
LB 2825 B44 
LB 2825 B5 
LB 2825 B67 
LB 2825 B73 



These six examples were taken from 
the shelflist to examine how the cutter 
number was changed in records and why. 
In all six, the cutter numbers found in the 
OCLC records corresponded to those in the 
shelflist. No adjustments were needed. 

Adjusting cutter for alphabetical order 
does not always produce desired results. 
Despite the efforts by the cataloging de- 
partment, strict alphabetical order is not 
always achieved. Some books are not in 
order due to changes in the shelflist pro- 
cedures and limitations of the old online 
system (LCS) in dealing with complicated 
cutter numbers (e.g., when the cutter 
number is more than three digits). 

Changing the Cutter Number to 
Follow OSUL Local Practice 

We also examined 64 records in which the 
cutter numbers were adjusted to fit OSUL 
local practice. Although OSUL primarily 
follows LC cataloging practices, it has also 
established local practices. Some of these 
were established to transcend the limita- 
tions of the old LCS system and are listed in 
the old LCS manual, while others were es- 
tablished for no discernible reason. 



Comparison of OSUL local practice 
with LC practice indicates that OSUL 
does not completely follow LC practice. 
For example, OSUL does not cutter for 
collected prose works, polyglot language 
publications, periodicals, society publica- 
tions, or serials. In cuttering for separate 
works, autobiography, and general works, 
OSUL uses its own cutter numbers. In 
general works, OSUL adds a third cutter 
for the main entry. 

OSUL established its own translation 
numbers by modifying and expanding the 
LC cutter numbers. OSUL also expanded 
the use of the LC translation tables. LC 
did not expand the translation numbers 
because in some classification schedules, 
translations are designated with the cap- 
tion "By language A to Z" and the date. 
In these cases, one cutters for the spe- 
cific language by using .E5 for English, 
.F7 for French, etc. For example, OSUL 
changed the cutter number for an Eng- 
lish-language translation of Erich Maria 
Remarque's work from OCLC PT2635 
E68 1513 to OSUL PT2635 E68 151. 

In other cases, OSUL has also estab- 
lished another local practice that differs 
from other libraries, particularly LC. If an 
item is a part of something or an adapta- 
tion, OSUL adds .xl7 to the cutter num- 
ber. If it is a work of criticism, LC adds 
.xl8 to the cutter number. For example, 
the cutter number for Erich Maria Re- 
marque by Richard Arthur Frida was 
changed from OCLC FT2635 E68 15 to 
OSUL PT2635 E68 1518. 

Although the number of records in 
which the cutter numbers have been ad- 
justed for local practice is very small, it 
takes much time to determine if the book 
requires cutter change or addition. It also 
takes time to alter a number from the cutter 
to accommodate local practices. Because 
the LC practice of adapting uniform stand- 
ards seems to satisfy their users, it seems 
reasonable to assume that this practice can 
be employed at the OSU Libraries. 

Additional Information from 
Other Libraries 

Additional information was gathered 
through an informal survey of other 
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libraries posted to the AUTOCAT and 
CIC listservs. The following questions 
were asked: 

• How do you ensure that the call num- 
ber for each title is unique? 

• Do you review every call number to fit 
the shelflist order, or do you accept 
call numbers as they are on the bibli- 
ographic record? 

• If you don't do shelflisting, what is the 
impact on the access to the book by 
patrons? 

Several librarians responded to the 
questions. Regarding the first question, 
one librarian mentioned that he added a 
digit to the OCLC call number to make it 
unique; two respondents indicated that 
they check the shelflist to make each title 
unique; while four indicated that they ac- 
cept the call number unchanged. 

Regarding the second question, the 
policy at four libraries is not to review 
every call number. One library reviews call 
numbers only for literary works. Two li- 
braries review all books. 

Regarding the third question, some li- 
brarians indicated that the importance of 
shelflisting varies from class to class. In 
literature, for example, alphabetical order 
is important, whereas in the sciences, 
date of publication is more important than 
alphabetical order. 

Final Recommendations 

As a result of the study, the CPAC made 
the following recommendations: 

1. Continue to adjust cutter numbers in 
class "P," "M," "N" to put new items 
in online shelflist alphabetical order. 

2. In all other cases, accept complete 
call numbers as they appear on copy 

3. Add the date of publication for all 
materials, if not present in the call 
number. 

4. Recommendations 1-3 address the 
use of call numbers present in copy. 
For original cataloging, follow the na- 
tional standards for creating new re- 
cords. 

5. Duplicate call numbers: 

a. When student shelvers find dupli- 
cate call numbers on books in the 
stacks (or when duplicates are found 



at any other point), they should be 
reported to supervisors, who should 
send the book with a note to the Cata- 
loging Department to adjust the cut- 
ter number. 

b. The Cataloging Department will 
also pursue other means of examining 
the rate at which duplicate call num- 
bers occur in order to evaluate the 
impact of this change, e.g., generating 
duplicate call numbers report form 
OSCAR (OSULs online catalog) 
6. The issue of keeping conferences and 
editions together, by means of call 
number or cutter number, arose dur- 
ing the course of the study. This issue 
should be examined by the CPR and 
CPAC. Recommendations will be 
discussed with Heads of the Under- 
graduate and Department Libraries 
and Main Library Public Service 
Heads. Also, a separate proposal will 
be made in regard to Special Collec- 
tions materials. 

The recommendations were submit- 
ted to and accepted by the assistant direc- 
tor for technical services. 

Conclusions 

The study showed that a large percentage 
of the adjusted cutters were in classes M, 
N, and P. Because these are classes in 
which creative works are systematically 
ordered by cutter number to achieve ef- 
fects more complex than mere arrange- 
ment by main entry within a specific class, 
they merit continued monitoring to 
achieve those special goals. Monitoring 
and adjusting the cutter number in other 
classes produces proportionally far fewer 
changes, and most of those changes 
merely maintain an already imperfect 
main entry arrangement within specific 
classes. The value added to call numbers 
by continuing to examine cutter numbers 
for all additions to the collection is insuf- 
ficient to justify the time and effort re- 
quired to maintain that practice. Limiting 
adjustment to classes P, M, and N means 
that only about two-fifths of added titles 
need to be examined for possible adjust- 
ment. Furthermore, class is an easily ap- 
plied criterion for culling items for which 
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further examination of the cutter number 
is necessary. The time saved on the other 
three-fifths of additions can be applied 
more productively to other cataloging ac- 
tivities. 
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Bibliographic Utilities 

and Latin American Collections 

Ketty Rodriguez 

There appears to be a conflict between the principles of cooperation in 
cataloging and the acquisition of Latin American materials. A recent look at 
the literature revealed that the availability of copy cataloging for Latin 
American imprints in the bibliographic utilities seems to be on the decline. 
The author surveyed large, medium, and small Latin American collections 
via the Internet to determine the usefulness of bibliographic utilities for 
cataloging Latin American material. It was found that some large collections 
use more than one utility. Library representatives said their institutions were 
using more than one utility because they were trying to receive the maximum 
benefit from copy cataloging. Some catalogers of Latin American imprints 
seem unaware of the decline of copy cataloging in the bibliographic utilities 
that has been documented in the literature. 



(Cooperation among libraries is one of 
the most discussed topics in library litera- 
ture. The drive toward standardization, 
which paved the way for automation, has 
been done with the ultimate purpose of 
enhancing cooperation. 

Over time, library cooperation has 
taken several forms: cooperative acquisi- 
tions and collection development, and co- 
operative cataloging. One of the most suc- 
cessful cooperative efforts in the area of 
acquisition/collection development was 
the Farmington Plan (Hendrik 1973), 
which divided responsibilities for acquisi- 
tions among the large research libraries in 
the United States . The ultimate purpose was 
to build basic research collections across the 
country to fulfill research and curriculum 
needs of faculty and students and at the 
same time to develop a unique research 
collection that was based on assigned sub- 
ject or country responsibility. Because the 



responsibilities were assigned for a prede- 
termined subject or for a particular coun- 
try collection, the chances of overlap were 
greatly reduced. Even after the Farm- 
ington Plan was no longer operational, 
libraries continued to honor their com- 
mitments and research collections contin- 
ued adding library materials in their as- 
signed areas (Grover 1991). 

Cooperative cataloging of library ma- 
terial was stimulated by the develop- 
ment of bibliographic networks in the 
1970s. The emergence of the OCLC 
Online Computer Library Center, Inc. 
(OCLC), the Research Libraries Infor- 
mation Network (RLIN), and the West- 
ern Library Network have had a great 
impact on the library community. From 
the beginning these bibliographic utili- 
ties allowed many libraries to automate 
their processes and, at the same time, 
achieve economies of scale. 
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More recently, however, some authors 
(Avram 1979; Sercan 1994) have ques- 
tioned the benefits derived from these 
bibliographic utilities. One author has 
suggested that because there are different 
reasons for cooperation in acquisitions, 
collection development, and cataloging, 
institutional conflict can arise among 
them (Grover 1991, 407). For example, 
the goal of cooperative collection devel- 
opment is that at least one copy of any 
item of research value must be made avail- 
able somewhere in the United States. Im- 
plicit in this goal is the value of diversity 
or the uniqueness of library collections. 
But shared cataloging is based on the prin- 
ciple of taking advantage of the homoge- 
neity, similarity, or overlap in library col- 
lections. One of the primary reasons for 
belonging to a bibliographic utility is to 
decrease the cost of original cataloging. 

In the literature on cataloging Latin 
American materials, a sentiment has been 
expressed that the uniqueness of Latin 
American collections means that they 
benefit less from bibliographic utilities 
than other, more standard collections. In 
fact, a librarian at Cornell University 
stated that when they started processing 
material locally in 1988, they stopped in- 
cluding their records in the RLIN data- 
base. She wrote: "Now other RLIN librar- 
ies are following this route and not 
entering their acquisition data on the util- 
ity" (Sercan 1994, 59). Several authors 
have written about the loss of autonomy 
suffered by library management when 
they subscribe to a bibliographic utility 
(Martin 1986; Hafter 1986). Often, cata- 
loging departments follow the directions 
established by the bibliographic utility 
rather than the individual needs of then- 
own institutions (Hafter 1986). The result 
is an unwanted loss of autonomy by the 
library cataloging department, with a sub- 
sequent loss in the staffs feeling of pro- 
fessional worth. 

The 1970s were characterized by the 
growth of bibliographic utilities. During 
that time technology was still very expen- 
sive and not nearly as powerful as today. 
Therefore, bibliographic utilities were in- 
dispensable for many libraries interested 
in automating various processes. But in 



the 1980s, more powerful and less cosdy 
technologies became available, such as 
CD-ROMs. There has been a spate of 
local networks made up of carefully se- 
lected sister institutions whose online 
catalogs are accessible to each other. With 
the growth of the Internet, many libraries 
are finding that catalogs of other institu- 
tions are readily available. 

The impact of these developments has 
not been overlooked by OCLC and RLIN. 
In a seminar sponsored by OCLC in Janu- 
ary 1991, concern was expressed that: "if 
no data exchange occurs then the result- 
ing isolation of libraries jeopardizes na- 
tional resources, and consequendy effec- 
tive library services" (Lowell 1991, 100). 

The realization by many libraries that 
there might be various new ways to per- 
form tasks once carried out by biblio- 
graphic utilities, plus the drive toward 
greater homogeneity (Perrault 1994) in 
academic libraries, tends to bring into 
question the usefulness of bibliographic 
utilities for copy cataloging of Latin 
American imprints. The central questions 
posed are: (1) Which bibliographic utili- 
ties are currently being used by Latin 
American collections? (2) Is there a pat- 
tern of use of these bibliographic utilities? 
(3) What is the usefulness of the utility in 
terms of the amount of copy cataloging for 
Latin American imprints? and (4) What 
are the possible causes of the decline in 
the usefulness of bibliographic utilities for 
the copy cataloging of Latin American 

Latin American Collections and 
the Information Explosion 

In an environment with an explosion of 
publications with ever-increasing prices, 
librarians are struggling to maintain their 
collections while being confronted with 
budget cuts, staff reductions, and techno- 
logical changes. With tax revolts reducing 
government revenues, and an aging popu- 
lation requiring more of the public 
resources that remain, universities — 
perceived as another self-serving bu- 
reaucracy — are receiving far less support 
than in the past. Area study collections 
that once were the library vanguard are 
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now seen as relics of an outdated library 
philosophy that emphasized ownership 
over access (Hazen 1993, 269). Despite 
the support received by area studies dur- 
ing the post-war period, area studies were 
struggling for survival by the 1980s. Area 
studies flourished in the post-war period, 
"only to collapse with the advent of peace" 
(Merkx 1993, 294). Some universities, to 
save staff and cut costs, have merged the 
special collections into the general collec- 
tion. Others have eliminated special lan- 
guage and area catalogers, expecting the 
cataloging to be obtained through the bib- 
liographic utility (Grover 1991, 407). 

In a 1983 study, Grover (1991) 
searched RLIN and OCLC databases to 
determine the speed of copy cataloging 
for 298 Spanish -language Latin American 
imprints. The researcher found that 
slightly more than one-tliird was cata- 
loged during the first six months and only 
one-twelfth during the last six months. 
The author found that a year after receiv- 
ing 298 Spanish-language imprints, 50% 
of the books had not been cataloged any- 
where in the United States. The author 
also found that there was little difference 
between the two utilities because both 
had the same number of books, although 
not the same books. Sercan (1994) carried 
out a similar study in 1992 with 783 Latin 
American Spanish-language imprints. 
Both studies used similar methodologies, 
and the purpose was the same: to gauge 
the speed of copy cataloging. In the more 
recent study, Sercan spaced the inquiry 
every four weeks instead of every six 
months. In this second study, the author 
found a marked decline in copy catalog- 
ing. In each study, the authors found that 
allowing more time slightly improved the 
results. 

At a time when institutions of higher 
education should be finding ways to pre- 
pare Americans for globalization, profi- 
ciency in foreign languages, and cross-cul- 
tural skills, the resources to support these 
goals, have declined. In recent research, 
Perrault (1994, 187) has revealed that in- 
stitutions of higher education are buying 
fewer foreign-language materials. The 
author compares the nonserials acquired 
by 72 ARL libraries in 1985 with those 



acquired in 1989. The researcher found 
an overall decline in the total number of 
nonserial imprints acquired by these li- 
braries. She also noted an alarming de- 
cline in foreign-language acquisitions, a 
decrease in unique titles on subject areas 
and an increase in the acquisition of core 
material. The net result of these trends will 
likely produce more homogeneity and less 
diversity in library collections. Such results 
would have serious implications for research 
and resource sharing. 

This shift of attention away from for- 
eign materials and from area studies is 
further documented in a study (Leazer 
and Rohdy 1994) on the level and quality 
of bibliographic control of foreign mono- 
graphs. In this study, the authors aimed 
to answer the following questions: To 
what extent is effective bibliographic control 
maintained over foreign publications? 
What proportion of the material is acquired 
and cataloged? Is the quality of cataloging 
sufficient? What are tfie specific quality 
problems encountered? and Is the material 
controlled in a timely manner? 

After analyzing in depth more than 
fourteen studies, they conducted a hase- 
line study. The results of their study con- 
firmed (p. 41) "that the differences in 
treatment of foreign and domestic mono- 
graphs is real and might even be greater 
than suggested by previous research. Ol 
special concern is the lack of any control 
over a significant proportion of foreign 
research monographs." The quality of the 
records for foreign monographs was 
lower than the quality for domestic 
monographs, but the differences in qual- 
ity were not as large as the differences in 
the extent of the coverage. 

Methodology and Data Analysis 

A survey of Latin American collections, 
selected by size, was conducted by using 
the Latin Americanists Librarians An- 
noucements List (LALA L) on the In- 
ternet. LALAL is a moderated list pre- 
pared by Gayle Williams of the Cataloging 
Department at the University of Georgia 
Libraries in Athens, Georgia. 

For the sake of consistency and com- 
parison, the Latin American collections 
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TABLE 1 

Groups of Collections Surveyed by Deal 



Gump 1—190,000 or more 


Group II— 100,000 to 189,000 


Croup III— 100.000 or less 


Cornell 


Arizona 


Brigham Young 


Duke 


Arizona State 


London 


Florida 


California San Diego 


New York University 


Illinois 


Massachusetts 


Notre Dame 


New Mexico 


Miami 


Ohio State 


North Carolina 


Minnesota 


Pennsylvania State 


Pittsburgh 


San Diego State 


Rutgers 


Princeton 


Vanderbilt 




Puerto Rico 






Southern California 






Texas 






California 






UCLA 






Yale 






Wisconsin 






Stanford 







included in this study are roughly the 
same collections used by Deal (1993). A 
questionnaire consisting of 5 questions 
was posted on LALA_L on February 22, 
1996; a total of 15 responses were re- 
ceived. This represents 50% of the 30 
responses received by Deal (1993), which 
were classified by size into 3 groups. 

Group 1 included those libraries with 
190,000 volumes or more; Group 2, librar- 
ies with 100,000 to 189,000 volumes; and 
Group 3, libraries with fewerthan 100,000 
volumes. Nine of the libraries (60%) in 
Group 1 responded; 4 (50%) from Group 
2 responded; and 2 (28%) from Group 3 
replied. 

The questions were: 

1. What bibliographic utility is currently 
being used to catalog Latin American 
material? Specify the starting date of 
the use of the utility. 

2. If you have switched to a different 
bibliographic utility, indicate both 
utilities, the date of the switch, and 
the reason for the change. 

3. If you are using more than one utility 
indicate the reason why. 



4. Rank the usefulness of each utility. 
(Use 1 to indicate the most useful and 
4 for the least useful.) 

5. Indicate the possible causes for the 
decline in the usefulness of biblio- 
graphic utilities for copy cataloging of 
Latin American imprints. (Use 1 as 
the most imporant cause and 4 as the 
least important cause.) 

Decrease of the hit rate. 

Decrease of quality 

Too expensive 

Loss of autonomy of administrators 

Alternative resources 

Other 

The usage of bibliographic utilities by 
Latin American collections is shown by 
library size in tables 2-6. Of the 15 re- 
spondents, 14 (93%) use OCLC. Only one 
uses RLIN exclusively. Three libraries 
currently use both utilities. The larger col- 
lections have switched Utilities but the 
other two groups continue to use the origi- 
nal utility selected. One reason for switch- 
ing, or in having both utilities, is that the 
librarian was looking for a higher hit rate, 
and thus faster processing of Latin Ameri- 
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TABLE 2 

Usage of Bibliographic Utilities by 
Large Collections 



Group I 


Bibliographic 
Utility 


Dates 
of Usage 


Cornell 


OCLC 


1973-1981 




RLIN 


1981-1988 


Duke 


OCLC 


1980- 


Florida 


OCLC 


1975- 


N. Carolina 


OCLC 


1978- 


Puerto Rico 


OCLC 


1988- 


S. California 


OCLC 


1976-1985 




RLIN 


1985- 


Texas 


OCLC 


1974- 


UCLA 


OCLC 


1978- 


Yale 


OCLC 


1974[?]-1977 




RLIN 


1977- 




OCLC 


1994- 



can imprints. The reasons given by librari- 
ans at two libraries using both utilities 
were "We are trying to get as much copy 
cataloging as is available" and "We use 
both because the bibliographic record ap- 
pears faster in OCLC than BLIN but 
sometimes we can not find the item in 
OCLC and we can in BLIN." 

Bespondents from the largest collec- 
tions also offered details about their rela- 
tionships with the utilities. Librarians 
from Cornell said that since 1988 they 
have done their cataloging on their local 
system and that tapes of this work are sent 
weekly to RLIN . They also noted that they 
are currently considering the use of FTP 
(file transfer protocol) for data exchange. 
Librarians from the University of South- 
ern California commented that although 
they are using OCLC primarily, they 
upload records to RLIN on a monthly 
basis. The librarians at Yale University, 
who observed that Yale is a founding 
member of RLG/BLIN, use their local 
system like Cornell, and upload their re- 
cords to both OCLC and BLIN. Librari- 
ans from the University of North Carolina 
indicated that 85% of their Latin Ameri- 
can collection has been cataloged. 



TABLE 3 

Usage of Bibliographic Utilities by 
Medium Size Collections 



Bibliographic 
Group II Utility 


Dates 
of Usage 


Miami OCLC 


1978- 


Minnesota OCLC 




San Diego State OCLC 


1977- 


California, 
San Diego OCLC 




TABLE 4 




Usage of Bibliographic Utilities by 
Small Collections 


Bibliographic 
Group III Utility 


Dates 
of Usage 


Rrigham Young RLIN 


1978- 


London OCLC 


1977- 


TABLE 5 




Banking of Usefulness of 
Bibliographic Utilities 


Utility Hank Libraries 


OCLC 1 


14 


OCLC & RLIN 2* 


1 


RLIN 4 


1 


•Two libraries used two utilities. One ranked them 
both as 2 The other one ranked RLIN as 4. 


TABLE 6 




Possible Causes of Decline in 
Usefulness of Utilities 


Possible Causes Rank 


Libraries 


Decrease of hit rate 1 


5 


Decrease of quality 2 


3 


Too expensive 





Loss of autonomy 





Alternative resources 





Other 


7 
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In the "other" category, 6 of the 7 li- 
brarians questioned the premise that the 
usefulness of the utilities has declined. If 
there has been a decline, they argued, it is 
probably connected to cut-backs that have 
limited the number of catalogers hired to 
do original cataloging. One librarian pro- 
vided numbers of books cataloged at her 
institution in 1995 and 1996. For 1995 the 
cataloging team for Iberia — including 
Spanish, Catalan, Portuguese, and Galle- 
gan material — and Latin America copy 
cataloged 6,242 books with copy and 
1,390 without copy cataloging. So far in 
1996 the same team has cataloged 4,729 
books with copy and 905 without copy — 
this includes about 1,500 new books sent 
to the backlog. The librarian giving the 
statistics demurred any comment on the 
decline because she could not give an ac- 
curate number due to the substantial 
backlog. 

Conclusions 

OCLC was utilized by 14 of the 15 Latin 
American collections. Most of the librar- 
ies began to use the utility in the 1970s. 
Three of the largest collections used both 
OCLC and RLIN. The librarian for one of 
those three collections ranked both utili- 
ties in the highest category. However, an- 
other ranked both utilities in the second 
category, while the third considered 
OCLC very useful but ranked RLIN as 
the least useful. 

Two reasons were given by the librari- 
ans for the use of both utilities: (1) they 
wanted to take advantage of as much copy 
cataloging as possible and (2) OCLC is 
often faster than RLIN, but they have 
more success finding the copy cataloging 
in OCLC than in RLIN. 

The data indicate that the growing 
backlog may be caused by the fact that 
fewer catalogers are doing original cata- 
loging. At the same time, one can also see 
from the data that the utilities are being 
used less and less frequently for copy cata- 
loging, thus exacerbating the growing 
backlog. If the utility is less useful in pro- 
viding copy cataloging, then the backlog 
continues to grow. However, 10 of the 15 
(66%) respondents did not agree with the 



literature cited about the reasons for the 
decline in copy cataloging. Those who 
protested claim that they depend heavily 
on the utilities for copy cataloging and yet 
the backlog continues to grow. 

Five of the respondents (33%) main- 
tain that if there is a decline in quality 
(which they doubt) it may be due to a 
decline in the number of hits. Only three 
respondents (20%) felt that there was a 
decline in quality. The remainder of those 
answering mentioned that they do not 
agree that there is a decline as claimed in 
the literature. 

The comments by the librarians were 
telling. One asked me to refer her to the 
studies alleging a decline in the availability 
of copy cataloging for Latin American im- 
prints. Another librarian agreed that there 
was an overall decline in buying power, 
but alleged that her budget had increased 
due to funding from private sources. 

It would appear that due to a growing 
backlog, perhaps brought about by reduc- 
tion of staff doing original cataloging, li- 
brarians in charge of Latin American col- 
lections have been slow to recognize the 
reduction in the availability of copy cata- 
loging records in the bibliographic utili- 
ties. This decline has been documented in 
the literature concerning Spanish-lan- 
guage material destined for Latin Ameri- 
can collections. Many of the librarians in 
charge of Latin American collections de- 
pend heavily on copy cataloging available 
from the bibliographic utilities. The decline 
may be due to the use of the utility and the 
procedure used by the system. If this is the 
real explanation, then it would also explain 
the growing numbers of backlogs. 
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If you have been searching for an easy way to authority control your 
library's current cataloging, try LTFs Authority Express service. 
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Thesis and Dissertation Citations 
as Indicators of Faculty 
Research Use of University 
Library Journal Collections 

Louise S. Zipp 

Citation analysis is a long-standing collection-evaluation tool often under- 
taken to investigate one aspect of library collection use, Citations from theses 
and dissertations are much more easily and comprehensively gathered than 
are citations voluntarily supplied by faculty. Using four studies in geology 
and biology, the Kendall coefficient of rank correlation tests the degree of 
association between journals most heavily cited by graduate students and 
those titles most heavily cited in faculty publications. Positive associations 
are confirmed in three data sets. Additional descriptive analysis shows that 
the 40 titles most heavily cited in theses and dissertations consistently 
contained about 70% of the top 40 titles cited by faculty, including most of 
the 12-15 top titles. If results are replicated, thesis and dissertation citations 
can be reliably used as a surrogate for faculty publication citations in 
evaluations of the research portion of library collection use. 



\ 

Ims research journal prices continue to 
climb, selectors search for tools that will 
enable them to understand better the de- 
mand on library journal collections. Stud- 
ies of circulation data and in-library use 
contribute to our understanding of what 
parts of a library collection are being used. 
The link between demand for research 
materials and use is most easily acliieved 
by direct analysis of the scholarly commu- 
nications process. Evaluation of the titles 
used in the process of discovery or prob- 
lem identification yields valuable infor- 
mation. The titles in which researchers 



publish and those titles that they cite in 
their works also serve to elucidate real and 
potential demand on library collections. 

Citation analysis as a surrogate for use 
has served to identify journals for selec- 
tion, de-selection, or off-site storage 
(Kelland and Young 1994). In research 
universities, faculty tend to be the most 
stable and vocal parties using research 
lib rary materials. By using locally-derived 
data, analysis of journal titles cited by this 
known clientele has been valued as a 
means to measure demand (Crotteau 
1991; Haas and Lee 1991; McCain and 
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Bobick 1981; Noga, Derksen, and Haner 
1994; Walcott 1994b; Wible 1990; Zipp 
1995). In these studies, however, the fac- 
ulty whose publications were examined 
represented small, discrete research 
groups. Dykeman (1994) measured the 
ability of the Georgia Tech library to sup- 
port research in all scientific disciplines. 
Instead of direct solicitation of faculty or 
use of department-generated lists, she 
searched INSPEC to discover faculty 
publications. Swigger and Wilkes (1991) 
used data from the Institute for Scientific 
Information (ISI) to discover references 
cited by authors affiliated with Texas 
Women's University. In some studies 
where the target population is smaller and 
more discipline- specific, the ease ol iden- 
tifying faculty citations from ISI products 
still outweighed the limitations of data- 
base coverage (Greene 1993; Schmidt, 
Davis, and Jaiir 1994; Williams 1990). 

Graduate students conduct research as 
part of a program of study that results in 
an advanced degree. Walcott (1994a) ob- 
served that graduate students were the 
most active serials users in the Biology 
Library at State University of New York at 
Stony Brook. She analyzed thesis and dis- 
sertation citations to determine the most 
useful serial titles to that group, and she 
wondered why most citation studies ignore 
this crucial element of research library cli- 
entele. In fact, a few studies have examined 
this segment of research use (Chambers and 
Healey 1973; Herubel 1991; McCain and 
Bobick 1981; Noga, Derksen, and Haner 
1994; Peritz and Sor 1990; Sylvia and Lesher 
1995; Walcott 1991; Zipp 1995). Thomas 
(1993) used this approach to study use by 
the only research clientele at a teaching 
institution. 

While graduate students are a tran- 
sient population, their research interests, 
to some extent, reflect those of their fac- 
ulty advisors. The product of graduate stu- 
dents' research is deposited in libraries 
and often indexed in general or thematic 
sources, such as Dissertation Abstracts 
International and GeoRef. Institution- 
specific studies of thesis and dissertation 
citations can use a full population or truly 
random sample of data, since the source 
documents can be identified and re- 



trieved without involving the authors 
themselves. 

Academic scientists in physics, chemis- 
try, biology, mathematics, and geology de- 
pend primarily upon library subscriptions or 
their colleagues' personal subscriptions for 
retrieval of journal articles they sub- 
sequently cite (Hallmark 1994). Graduate 
students do not tend to have a network in 
place to make effective use of colleagues 
f or discovery or retrieval of publications 
relevant to their research. Because they 
are more dependent upon library collec- 
tions than are faculty, citation analysis of 
graduate student research may provide a 
more accurate snapshot of collection use. 

In 1994, I undertook a comparative 
study to discover geology graduate student 
and faculty research journal use at the three 
state universities in Iowa (Zipp 1995). I was 
easily able to compile thesis and dissertation 
citations for a three-year period, but I en- 
countered problems compiling even a rep- 
resentative sample of faculty citations. 
There were no institutional lists of faculty 

C'slications, and GeoRef, the primary index 
geology, was known to be selective and 
delayed in its coverage. Given also that the 
earth sciences literature was not well repre- 
sented in ISI products, I contacted faculty 
directly and requested information on their 
publications released from 1991-1993. 

Schmidt, Davis, and Jahr (L994) sug- 
gested that faculty journal citations may 
be assumed also to represent graduate 
student use. McCain and Bobick (1981) 
had noted similarities among journal titles 
most cited in faculty publications and dis- 
sertations. They cautioned that data from 
dissertation citations, without considering 
those from faculty publications or Ph.D. 
qualifying briefs, were inadequate to de- 
termine the scope of research journal use. 
Noga, Derksen, and Haner (1994) ob- 
served that thesis and dissertation cita- 
tions and faculty citations could not be 
used to predict each other. Given the 
value and viability of analysis of local data 
as a tool for refining library research jour- 
nal collections, it is important to examine 
the strength of the relationship between 
these two measures of use. The purpose 
of this research is to determine to what 
degree graduate student research use of 
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journal collections can be expected to also 
represent faculty research use. 

Methodology 

To reduce the gaps in faculty citation 
coverage, described in Zipp (1995), I re- 
solicited nonresponsive geology faculty in 
underrepresented sub disciplinary areas. 
While this follow-up was somewhat suc- 
cessful, it was also necessary to search 
GeoRef for publications by faculty who 
never responded. Some coverage was 
eventually achieved for all subdisciplinary 
areas, except earth science education. 
2,127 faculty journal citations were com- 
piled, and 1,208 journal citations were 
found in theses and dissertations. The two 
sets of forty journal titles most frequently 
cited by faculty and graduate students 
were combined into a sample of 52 titles 
(table 1). 

A test of rank correlation was applied 
to reveal any comparability of the relative 
value of titles to each user group. The 
Kendall coefficient of rank correlation, 
Kendall's x , represents the net proportion 
of concordant pairs in a sample, from 
which the proportion of discordant pairs 
has been removed (Gibbons 1993). The 
test is appropriate for samples with nu- 
merous ties. The titles were ranked, and 
the test was applied as described in Sokal 
and Rohlf (1995), including the use of 
correction factors for ties. 

Few recent citation studies compare 
graduate student and faculty citations, 
and none use the Kendall coefficient of 
rank correlation to test the strength of a 
relationship. To provide a context for in- 
terpretation of my findings, I applied the 
test to three sets of published data, two in 
the geological sciences and one in biology. 
Collectively, these results can establish a 
baseline for subsequent use of this test in 
citation analysis. 

The Stanford and UCLA Studies 

Use studies were done at the UCLA Ge- 
ology/Geophysics Library and the Stan- 
ford Branner Earth Sciences Library 
(Noga, Derksen, and Haner 1994). As part 
of the study, geology theses and disserta- 



tions for 1990 and 1991 deposited at each 
university, as well as a few more to com- 
plete subject coverage, were analyzed for 
citations to journals and monographic se- 
ries held at each respective library. Stan- 
ford theses and dissertations yielded 
7,652 citations, and UCLA sources 
yielded 2,893 citations. At Stanford, bibli- 
ographies of faculty publications from 
1991 were analyzed for citations to jour- 
nals and monographic series. At UCLA, 
faculty publications were analyzed for 
both 1990 and 1991. The Stanford faculty 
sample contained 3,460 citations, and the 
UCLA sample included 1,402 citations. I 
analyzed the data from each institution 
separately because of the quantity and 
reliability of information. In both cases, 
the same methodology devised for analy- 
sis of the Iowa citations was also used. The 
combined Stanford sample of the forty 
most heavily cited titles by both groups 
actually included 52 titles. The combined 
UCLA sample contained 56 titles. 

The Temple Study 

An earlier study in the biological sciences 
provided 1,793 journal citations from fac- 
ulty publications and 632 citations from 
dissertations (McCain and Bobick 1981). 
The authors had analyzed Ph.D. qualify- 
ing briefs, dissertations, and scholarly 
publications of full-time faculty in the 
Temple University Department of Biol- 
ogy for 1975-1977. From the authors' ta- 
ble of the most highly cited titles, I ex- 
tracted a combined sample of dissertation 
and faculty citations using the same meth- 
odology as employed with the Iowa analy- 
sis. The combined sample consisted of 60 
titles. 

Results 

For the Iowa data, a Kendall's t of 
0.3415654 was calculated. The range of 
possible values for t is -1.0 to +1.0, rep- 
resenting a perfect negative relationship 
and a perfect positive relationship, re- 
spectively; a t -value of signifies no rela- 
tionship. According to Gibbons (1993), 
a x-value is not comparable to the more 
commonly used r s -value of the Pear- 
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TABLE 1 




Journals Most Hea 


vim Cited by Iowa Geology Authors 


Journal Title 


Thesis and 
Dissertation Citations 


Faculty 
Citations 


Geological Society of America 
Bulletin 


SO 


121 


Journal of Paleontology 


62 


133 


Journal of Sedimentary Petrology 


62 


89 


American Association of 
Petroleum Geologists Bulletin 


56 


65 


Geochimica et Cosmochimica 
Acta 


48 


64 


Economic Geology 


41 


28 


Journal of Geology 


38 


22 


Soil Science Society of America 
Journal 


38 


11 


Abstracts with 
Programs — Geological Society 
of America 


36 


116 


Ground Water 


33 


23 


Journal of Geophysical Research: 
JGR 


32 


67 


Journal of the Iowa Academy of 
Science: JIAS 


32 


59 


Contributions to Mineralogy and 
Petrology 


30 


60 


Geology 


30 


88 


Science 


30 


49 


American Mineralogist 


24 


47 


Geoderma 


24 





Earth and Planetary Science 
Letters 


21 


66 


r 1 T TT J 1 

Journal of Hydrology 


21 


15 


Nature 


20 


46 


Paleobiology 


20 


14 


Water Resources Research 


19 


73 


Canadian Journal of Earth 
Sciences 


18 


26 


Soil Science 


18 


3 


Hull p 'tin of tnp Cptitrp nl 

Excellence in Geology 


15 





Quaternary Research 


13 


29 


Journal of the Geological Society, 
London 


12 


27 


Lethaia 


12 






Continued on Next Page 
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TABLE 1 (continued) 



Journal Title 


Thesis and 
Dissertation Citations 


Faculty 
Citations 


Sedimentology 


12 


28 


Journal of Ecology 


11 


3 


Bulletin of Marine Science 


10 


7 


Canadian Geotechnical Journal 


10 


4 


Eos 


10 


28 


Marine Ecology Progress Series 


10 





Marine Biology 


9 


4 


Philosophical Transactions of the 
Royal Society of London 


8 


9 


Restoration and Management 
Notes 


8 





Tectonophysics 


s 


H 


Coral Reefs 


7 


4 


Tectonics 


7 


20 


Journal of Metamorphic Geology 


6 


10 


Chemical Geology 


5 


15 


Journal of Petrology 


5 


32 


Ecology 


4 


14 


Geological Magazine 


4 


16 


Precamhrian Research 


4 


17 


Canadian Mineralogist 


3 


10 


Journal of Environmental Quality 


3 


16 


American Journal of Science 





45 


Geophysical Research Letters 





14 


Journal of Structural Geology 





11 


Mineralogical Magazine 





19 



son product-moment correlation coeffi- 
cient, whose value tends to fall farther 
from zero. 

Because the x distribution approaches 
normality with sample sizes greater than 
30, a z-statistic of 3.57 was calculated 
(Sokal and Rohlf 1995). Using a one-tailed 
test, the probability of finding a x of 
0.3415654 is 0.0002, which is significant 
at a 5% confidence level. Thus, the null 
hypothesis of no relationship between the 
variables can be rejected. The alternate 
hypothesis of a positive relationship can- 
not be ruled out (table 2). 



Kendall's x for the Stanford data is 
0.2250267, and the P-value is 0.0091, sup- 
porting a positive relationship between 
the variables, although the relationship is 
weaker than in the Iowa case (table 2). 
Kendall's x for the UCLA data is 
0.1080369, which, although positive, did 
not lead to a P-value large enough to re- 
ject the null hypothesis (table 2). The 
Temple analysis yielded a Kendall's x of 
0.3425445, which is high enough to infer 
a positive relationship between the two 
variables (table 2). 

While the range of variability in these 
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TABLE 2 
Results of Test for Association 



Subject Sample Size X- Value I '- Value 



Iowa 


geology 


52 


0.3415654 


0.0002 


Stanford 
(Noga, Derksen, and Haner 1994) 


geology 


52 


0.2250267 


0.0091 


UCLA 

(Noga, Derksen, and Haner 1994) 


geology 


56 


0.1080369 


0.119 


Temple 
(McCain and Bobick 1981) 


biology 


60 


0.3425445 


0.00003 



findings was unexpected, it is important to 
note that the Iowa and Temple studies 
only considered journals, whereas the 
Stanford and UCLA studies also incorpo- 
rated monographic series, including 
open-file reports and map series. Al- 
though these formats were important to 
the goals of the original studies, they may 
have diluted the effect of journals in these 
samples. 

Even though the test has confirmed 
the relationship that most selectors would 
have already assumed, the lack of compa- 
rable published data does not quite an- 
swer the original question. Doing so re- 
quires a more descriptive interpretation 
of the original ranked lists set into a con- 
text of possible uses. 

In most research university libraries, 
marginal subscriptions were canceled 
long ago, and new subscriptions are not 
often placed without evidence of local de- 
mand. Document delivery, interlibrary 
loan, or non -library sources are expected 
to supply clientele with articles published 
in more specialized journals. Selectors are 
more likely to need lists of core journals, 
to ensure protection of those titles, usually 
for a designated clientele. To this end, 
how effectively does research use by 
graduate students predict research use by 
faculty? 

The four data sets used for the statisti- 
cal test were reexamined to provide a de- 
scriptive measure of the extent that one 
variable might predict the other (table 3). 



The ten titles most frequently cited in 
theses and dissertations did not effectively 
predict the ten titles most heavily cited by 
faculty. Somewhat more surprising is the 
consistency with which the top 40 titles 
used by graduate students predicted the 
top 40 titles used in faculty publications. 
Amplifying the strength of this association 
is the fact that the 40 titles most heavily 
cited by graduate students included 
nearly all of the top 12-15 titles most cited 
by faculty. 

Conclusion 

Journal citations in theses and disserta- 
tions are better indicators of faculty use 
than has been previously assumed. A test 
for rank correlation showed that three of 
four investigations confirmed similar rela- 
tive value for the same titles. To validate 
this conclusion and provide a basis for 
comparison, more data sets must be 
tested with a statistical measure of rank 
correlation. As the strength of this associa- 
tion is defined, the value of this approach 
for prediction must be further investigated. 
A less informative, but more striking, de- 
scriptive analysis showed that in all investi- 
gations about 70% of the faculty's 40 most 
cited titles were among the 40 cited most 
heavily by graduate students . This result also 
needs further examination. 

Citation analysis remains a respected 
technique of collection evaluation. It re- 
quires time and diligence, coupled with 
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TABLE 3 
Results of Prediction Analysis 



Study 


% of Top 10 Faculty Titles 

Appearing in Top 10 
Thesis/Dissertation Titles 


% of Top 40 Faculty Titlesi 

Appearing in Top 40 
Thesis/Dissertation Titles 


% of Top 12-15 Faculty 
Titles Appearing in Top 40 
Thesis/Dissertation Titles 


Iowa 


60 


70 


100 (of top 15) 


Stanford 


50 


71 


100 (of top 12) 


UCLA 


42 


69 


75 (of top 12) 


Temple 


70 


70 


93 (of top 15) 



consistency and good data-handling skilis. 
By choosing a method of data acquisition 
that avoids voluntary submission, re- 
searchers can actually gather a true popu- 
lation of citations. The most heavily cited 
journal titles in theses and dissertations 
can be used as a surrogate for the titles 
most heavily used by faculty in their pub- 
lications. When appropriate sample sizes 
are considered, selectors can develop core 
lists of journals critical to local users and 
fully representative of the research por- 
tion of collection use. 
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Notes on Operations 



Using Verbal Reports to 
Understand Cataloging 
Expertise: Two Cases 



Ling Hwey Jeng 



The author discusses the use of verbal reports in protocol analysis to study 
the quality of cataloging knowledge and skills. The author begins with a 
discussion of the literature on expertise and on the use of verbal reports and 
protocol analysis in general, andpraceeds to present two examples of the use 
of verbal reports collected as part of a research project on cataloging 
expertise. Using findings derived from the verbal reports, the author { 
trates the process of hypothesis generation for f 



ho are expert cataloged? What does 
it take to become one? How do they gain 
their expertise in cataloging? What is the 
best way to transfer their knowledge to 
beginning catalogers so that beginning 
eatalogers can be better trained in a 
shorter time? In this age of artificial intel- 
ligence and expert systems, what knowl- 
edge and heuristics should a cataloging 
system possess to perform like an intelli- 
gent human cataloger? These questions 
focus on two quality-related terms com- 
monly heard among catalogers: profes- 
sional and expert. Although not univer- 
sally agreed upon, the term expert in 
cataloging is usually used to descrihe a 
ne combination of 



experience, knowledge of a special type of 
material, special language skill, and affili- 
ation with a prestigious library institution. 
Conventional wisdom such as this helps 
only to distinguish noncatalogers from 
catalogers at a very superficial level; it is 
not meaningful in answering the above 
questions at any specific level. Although 
the potential for expert system applica- 
tions in cataloging has long been recog- 
nized (Ercegovac 1984), the recent devel- 
opment of cataloging expert systems (e.g., 
Davies and James 1984; Hjerppe, et al. 
1985; Ercegovac and Borko 1992) pro- 
vides little practicality beyond prototyp- 
ing and demonstration (Fenly 1990). The 
major obstacle to the success of expert 
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systems for cataloging remains in the un- 
knowns of the knowledge base — that is, 
cataloging expertise (Davies 1992; Hjer- 
ppe and Olander 1989; Meador and 
Wittig 19.91; Jeng 1992; Abrera and 
Shaw 1992; Jeng and Weiss 1994). This 
paper describes the use of protocol 
analysis and its resulting verbal reports 
to study the general strategies, mental 
models, and problem-solving methods 
among expert catalogers. 



Expertise 

To understand what experts do in cata- 
loging, it is necessary to begin with an 
understanding of what expertise is in the 
context of a profession. The Random 
House Dictionary defines expertise as "a 
high degree of skills, dexterity or knowl- 
edge of a specific subject area." Johnson 
et al. (1988) say that expertise is a kind 
of operational knowledge, "charac- 
terized by generativity, or the ability to 
act in new situations, or the capacity to 
achieve problem solutions." In problem 
solving such as that found in most pro- 
fessional tasks, expertise is basically a 
set of requirements that must be satis- 
fied in order to solve problems in a given 
domain. Literature shows that experts 
behave differently from nonexperts. La- 



France (1989) describes the characteristics 
of experts' behaviors and how they differ 
from those of novices. He divides the char- 
acteristics into three areas: general knowl- 
edge, problem-solving skills, and memory 
structure (see table 1). 

It is believed that experts recognize 
more complexity and can attend to multi- 
ple cues at one time. Furthermore, they 
know that the importance of some fea- 
tures is contingent on whether or not 
other features are also present (Johnson 
et al. 1981). Experts not only know how to 
recognize the relevant elements in their 
problem domains but also know how the 
elements interact and vary with context. 

The approaches to problem solving 
used by experts and novices are different. 
Studies show that expert chess players re- 
call move sequences in terms of attack and 
defense strategies (i.e., schema- driven), 
whereas novices recall them in terms of 
spacial position (i.e., data-driven). Ex- 
perts often conduct qualitative analyses of 
problems and categorize the problems 
into recognizable types; novices link spe- 
cific features of problems with specific 
solutions. Experts focus more on overall 
goals, while novices focus more on effects. 
For example, observations suggest that 
expert basketball players focus on their 
goal or plan rather than specific events or 
event sequences. Novices have limited 
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ability to generate inferences and rela- 
tions that are not explicitly provided. 

Speed is another characteristic that 
distinguishes experts from novices in 
problem solving. Expert bridge players 
are like robots. They have great difficulty 
adapting to the game when changes are 
made in the rules, especially when the 
changes are extensive. Novices' perform- 
ance is less drastically affected by rule 
changes. Experts' knowledge structures 
are so committed to memory and so at- 
tached to particular strategies that dis- 
rupting them causes their entire problem- 
solving process to be thrown into disarray. 

Experts tend to organize their memo- 
ries by looking for meaningful relations 
among smaller units and grouping them 
into larger chucks {Chamess 1976; Chase 
and Simon 1973). In a study of architec- 
tural expertise, Akin (1980) found that 
expert architects recall building plans at 
several levels, beginning with local pat- 
terns (wall segments and doors), then 
rooms, then clusters of rooms. Experts 
also rely on a higher level of abstraction in 
their memory organization. For example, 
when asked to replicate drawings, expert 
electronic technicians do so according to 
the functional nature of the components 
of a circuit, such as amplifiers, rectifiers, 
and filters. Novice technicians however, 
produce copies based more on the spatial 
proximity of the presented elements 
(Egan and Schwartz 1979). 

The quality of memorized experience 
is also different between experts and nov- 
ices. Novices tend to form semantic mem- 
ory, which is the knowledge of facts, hier- 
archically arranged. Experts, on the other 
hand, have good episodic memory, i.e., 
the knowledge of situations constructed 
from experience. Episodic memory re- 
cords and organizes events such that do- 
main concepts are related to each other 
according to their concurrence in the 
same episode. Experts are also able to 
organize individual episodes into general- 
ized abstract situations in their memory 
(Kolodner 1983). 

While LaFrance addresses the differ- 
ences between experts and novices in gen- 
eral, authors of other studies attempt to 
address the process of acquiring expertise 



in particular subject areas. Benner (1984), 
for example, devotes several chapters to a 
discussion of various levels of knowledge 
from novice to expert and how a novice 
becomes an expert in clinical nursing. She 
identifies five levels of expertise in nursing: 

Stage 1 is called the Novice level. At 
this stage, nurses are taught about situ- 
ations in terms of objective attributes and 
features of their task world that can be 
recognized without situational experi- 
ence, as well as context-free rules to guide 
action with respect to different attributes, 
The rule-governed behaviors of novice 
nurses are extremely limited and inflex- 
ible. They have little understanding of the 
contextual meaning of textbook terms. 

At stage 2, the Advanced Beginner 
level, the nurses demonstrate marginally 
acceptable performance. Having coped 
with enough real situations, they are now 
able to note the recurring meaningful si- 
tuational components, also called aspects 
of the situation. 

Nurses are said to have acquired the 
knowledge of stage 3, the Competent 
level, typically after they have been on the 
job in similar situations for 2 to 3 years. 
They begin to see actions in terms of long- 
range goals and perspectives, and are able 
to plan their action or solution based on 
considerable conscious, abstract, analytic 
contemplation of the problem. Although 
at this stage the nurses still lack the speed 
and flexibility of experts, they do have a 

with contingencies of clinical nursing. 

At stage 4, the Proficient level, nurses 
are able to perceive situations as wholes in 
terms of long-term goals rather than as 
individual aspects. They can recognize 
when the expected normal picture does 
not materialize and possess holistic under- 
standing that helps decision making. 

When the nurses reach the highest 
level of knowledge — stage 5, the Expert 
level — they no longer rely on a single ana- 
lytic principle (rule, etc.) or their under- 
standing of the situation to actions. They 
now have an intuitive grasp of each situ- 
ation and zero in on the accurate region of 
the problem without wasteful considera- 
tion of a large range of unfruitful, alterna- 
tive diagnoses and solutions. 



346/ LRTS • 40(4) • Jeng 



Knowledge Acquisition 

Studies of learning and knowledge acqui- 
sition processes abound in cognitive and 
educational psychology. Knowledge ac- 
quisition has also been a topic of interest 
among researchers in library and informa- 
tion science (LIS) during the past decade. 
Richardson gives an overview of the tech- 
niques for knowledge acquisition appro- 
priate for LIS in his discussion of knowl- 
edge-based systems in general reference 
work (1995). Ercegovac (1992) provides 
an empirical study of knowledge acquisi- 
tion specifically applied to the interpreta- 
tion of authorship of cartographic materi- 
als in map cataloging. In her study, she 
uses three elicitation methods, including 
one unobtrusive and two obtrusive meas- 
ures. The obtrusive methods involve a 
face-to-face open interview and a one- 
page, paper-and-pencil, forced-format 
questionnaire. The unobtrusive measure 
consists of a content analysis of a sample 
of 499 machine-readable cartographic en- 
tries. 

Other researchers concentrate their 
studies on the process of acquiring spe- 
cific skills. For example, Cooper (1991) 
discusses user skill acquisition in office 
information systems during a three-year 
study designed to evaluate users' abilities 
to utilize functions and features of an in- 
formation system. Hoffman (1989) pro- 
vides a survey of methods used by re- 
searchers for eliciting expert knowledge. 
He places the typical methods of expert 
knowledge elicitation into three catego- 
ries: (1) observation of familiar tasks; (2) 
unstructured, free-flowing interviews; 
and (3) protocol analysis of special tasks. 

Verbal Reports of 
Protocol Analysis 

The use of protocol analysis can be 
traced to the beginning of this century 
(Erickson and Simon 1985). Protocol 
analysis is the process of analyzing the 
work situation (i.e., a protocol) of a subject 
(whether an expert or a learner) in order 
to understand the procedures, knowl- 
edge, or skills involved. To allow ampie 
time for analysis and to avoid missing spe- 



cifics in the process, the subject is often 
asked to perform routine work (such as 
cataloging a book), in which the work situ- 
ation is recorded. The protocol can be 
recorded via audiotape, videotape, or 
written notes. 

Protocol analysis has been used as a 
method in expertise studies in the areas of 
instructional design (Rowland 1992), gen- 
eral problem solving (Saiz and Breuleux 
1992), and writing (Smagorinsky 1991). 
Protocol analysis is used not only for un- 
derstanding humans but also for the 
knowledge acquisition process in building 
expert systems. Martin and Redmond 
(1989) show the potential of automatic 
knowledge acquisition in diagnostic do- 
mains by coding expert protocols into ma- 
chine-readable form in a diagnostic sys- 
tem. The system uses the expert's 
knowledge to solve similar problems that 
occur in the future and also to apply newly 
learned information to novel but similar 
cases. Protocol analysis has also been used 
in studies of LIS (for example, see Belkin 
and Brooks 1987; Saracevic 1989). Re- 
cently Thomas (1993) used a think-aloud 
protocol in a qualitative study of novice 
users to study the user interface of ERIC 
on the Macintosh 

Verbal reports are a tool commonly 
used in protocol analysis. Subjects are 
asked to verbalize their activities while 
performing a particular task. The subject 
may be asked to describe the process as it 
occurs or to "think aloud" in work situ- 
ations involving problem solving or deci- 
sion making. The interviewer remains si- 
lent in the background during protocol 
recording and only speaks out occasionally 
to prompt the subject for further explana- 
tions, The use of verbal reports through 
think-aloud methods is explained in detail 
by van Someren et al. (1994), who de- 
scribe the think-aloud method as a "very 
direct method to gain insight in the knowl- 
edge and methods of human problem- 
solving." Verbal reports can also provide 
information about both sophisticated and 
general mental processes that are difficult 
to obtain by other research methods. Ver- 
bal reports are especially useful, accord- 
ing to van Someren et al., in investigating 
differences in problem-solving abilities 



LRTS • 40(4) • Notes on Operations /347 



among people, differences in difficulty 
among tasks, effects of instruction, and 
other factors that have an effect on prob- 
lem solving. 

The use of verbal reports has some 
limitations. Even within normal work set- 
tings, verbal reports are an obtrusive tool 
for studying learning behaviors. As with 
other obtrusive research methods, sub- 
jects under study using verbal reports are 
fully aware of research objectives. With 
the outcome in mind, some subjects may 
try to please the researchers, although 
Norris (1990) concludes in his study that 
the obtrusiveness does not alter subjects' 
thinking and performance. Verbal reports 
are used for direct recording of the think- 
ing and reasoning process, and are differ- 
ent from the "secondary elaboration" 
method often used to study memory recall 
(Elmes and Bjork 1975). 

The use of verbal reports has proved 
valuable in studies of learning and knowl- 
edge acquisition in spite of their limita- 
tions. For example, Schael and Dionne 
(1991) conclude that a subjects lack of 
familiarity with the technique of protocol 
analysis does not affect his or her ability to 
participate in the protocol analysis. 

Cataloging Knowledge Base 

Cataloging is the process of creating sur- 
rogates for documents and other bibliog- 
raphic items, which involves two basic 
functions: description and summarization 
(Jeng 1993). In the description process, 
the cataloger describes the physical attrib- 
utes of the item and determines useful 
access points to the item. In summariza- 
tion, the cataloger attempts to summarize 
the intellectual content of the item by 
giving it one or more subject headings and 
by assigning it a classification number to 
represent the aboutness of the intellectual 
content and position the item in the con- 
ceptual map of the collection. 

To fulfill Cutter's objects and to facili- 
tate end-user retrieval (Cutter 1904), the 
system of surrogates must allow known- 
item searching, category searching, and 
selection among items. Three kinds of 
knowledge enable catalogers to achieve 
these objectives: (1) knowledge about the 



item itself (both bibliographical and sub- 
ject knowledge), (2) knowledge about us- 
ers, and {3} knowledge about the desired 
surrogate as the end product. To ensure 
end-user searchability and predictability, 
catalogers must also be aware of another 
objective in the cataloging process, that is, 
to maintain the integrity of the system 
(Malinconico 1974). In order to maintain 
system integrity, catalogers need two 
other kinds of knowledge: (4) knowledge 
about system configuration, and (5) 
knowledge about how to provide consis- 
tency in the process of creating surro- 
gates, i.e., knowledge about tools and 
rules used for record production and 
authority control. The objectives of facili- 
tating end-user retrieval and maintaining 
system integrity represent two very differ- 
ent perspectives in library cataloging; 
both must be taken into account when 
mapping the cataloging knowledge base. 

The five categories of cataloging 
knowledge, recognized as basic compo- 
nents of the cataloging knowledge base 
(Jeng and Weiss 1994), have been dealt 
with unevenly in studies on cataloging 
education and training. A cursory exami- 
nation of cataloging literature suggests a 
common belief that there are two stages 
of knowledge acquisition in cataloging: 
the education the cataloger receives in an 
LIS program, and experience in the prac- 
tice of cataloging. It is commonly held that 
cataloging education is inadequate in 
shaping cataloging expertise (Avram 
1989). There is little evidence in the lit- 
erature as to what knowledge catalogers 
acquire in formal schooling and what 
knowledge they acquire in practice. 
Fitzgerald (1989), in a case report of cata- 
loging training at Harvard, points out four 
practical goals for his training program: 
(a) to bring catalogers "to an appreciation 
and mastery of the complexity [of bibliog- 
raphic records] in the most expeditious 
way while contributing to the accomplish- 
ment of the Department's production 
goals for the year"; (b) to "teach the crea- 
tion of bibliographic and authority records 
and file maintenance"; (c) to "develop the 
habit of research in the cataloger"; and (d) 
to have students "leam to understand the 
meaning of rule-governed creativity." 
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However, little is said in his paper about 
what knowledge enables the cataloger to 
reach these goals. A recent ALA commit- 
tee document enumerating essential ele- 
ments of train ing programs for entry-level 
professional catalogers places heavy em- 
phasis on system configurations and cata- 
loging rules yet deals very little with other 
categories of cataloging knowledge (Asso- 
ciation for Library Collection and Techni- 
cal Services . , . 1994). A search beyond 
the area of cataloging education and train- 
ing reveals a handful of studies on expert 
performance in subject analysis and in- 
dexing. These constitute two groups. The 
first group concerns the issues of consis- 
tency in indexing performance (Markey 
1984; Chan 1989; Sievert and Andrews 
1991; Giral and Taylor 1993). Most of the 
studies found significant inconsistencies 
in assigning indexing terms or subject 
headings and document the effects of 
such inconsistencies on information re- 
trieval. None of the studies, however, goes 
further to investigate the causes of and 
possible knowledge discrepancies behind 
the inconsistencies. The other group fo- 
cuses on the economic aspect of the proc- 
ess, such as time or cost involved in cata- 
loging and indexing (Line 1969; Reynolds 
1975; Kautto 1992). For example, ac- 
cording to Kautto, catalogers spend equal 
amounts of time in analyzing a document 
and assigning indexing terms to a docu- 
ment. 

Data Collection 

In an attempt to study the quality of cata- 
loging expertise and knowledge base, a 
project was conducted in which the 
author analyzed the cataloging process 
and knowledge used by expert catalogers 
at the Library of Congress (LC), The goal 
of the project, titled Project Cataloging 
Expertise, was to identify individual and 
organizational factors that contribute to 
the establishment of cataloging expertise. 
More specifically, the project attempted 
to answer the following research ques- 
tions: 

• What are the knowledge and qualifi- 
cations possessed by expert catalog- 
ers? 



• What are the major tasks involved in 
cataloging? 

• What skills do catalogers exhibit in the 
process of cataloging? 

• What strategies and patterns do ex- 
pert catalogers use in cataloging? 

• What are the specific problems of 
cataloging training? 

Project Activities 

To collect data for the project, the author 
spent a total of 15 weeks at the Library of 
Congress under the sponsorship of LC's 
Visiting Research in Cataloging Program. 
Activities during the duration of her re- 
search residency included: 

• a questionnaire survey, which in- 
volved the design of a questionnaire 
and sample selection, the distribution 
of questionnaires, and follow-up for 
nonreturns; 

• a verbal report exercise, in which vol- 
unteers were asked to keep verbal re- 
ports of their cataloging cases accord- 
ing to written instructions given by the 
author; 

• verbal protocol recording, in which 
the author met with selected senior 
cataloger volunteers during a typical 
cataloging session in which the cata- 
logers were asked to think aloud as 
they cataloged and which the author 
recorded and documented with notes; 
and 

• observation, in which the author par- 
ticipated in an one-on-one training 
process in order to observe the ex- 
perts' cataloging environment (see ta- 
ble 2). 

Only two methods, the protocol inter- 
view and the verbal report exercise, are 
described here to limit the scope of this 
paper. 

Research Methodology 

Protocol Interview 

Initial interviews were conducted with di- 
vision heads to gather information and 
rovide orientation. These interviews 
elped the author plan the protocol analy- 
sis in two phases: protocol interviews and 



LRTS • 40(4) • Notes on Operations /349 



TABLE 2 
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Cataloging Expertise 
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a verbal report exercise. For the protocol 
interviews, expert catalogers with profes- 
sional job rankings were invited to partici- 
pate in an interview in which they were 
asked to conduct a regular work situation 
(i.e., to catalog two items) and to docu- 
ment the process by thinking aloud. The 
protocols of their cataloging work were 
recorded. 

Verbal Report Exercise 

A second form of protocol analysis was 
also given to those expert catalogers who 
preferred not to he interviewed. They 
were asked to complete a self-adminis- 
tered verbal report exercise. Each cata- 
loger was given specific instructions and 
asked to catalog a typical item. The cata- 
loger submitted a verbal report detailing 
the step -by-step process of problem solv- 
ing and decision making in the cataloging 
case. 



Voluntary Participation 

Because of the obtrusive nature of the 
research method and the large amount of 
time involved, participants were selected 
for the project on a voluntary basis. A 
letter was sent to every cataloger with 
professional rank (GS-11 or above) in 41 
cataloging teams (reaching a total of 367 
professional catalogers) asking for volun- 
teers to participate in protocol analysis. 
Fifty-eight positive responses (15.8%) 
were received. Twenty-one protocol in- 
terview sessions were conducted, and 24 
verbal reports were received from catalog- 
ers who participated in a self-administered 



verbal report exercise. Seventy-three bib- 
liographic records and 49 authority re- 
cords were created or modified during this 
project. 

Content analysis was the primary 
method used in analyzing the data col- 
lected. The emphasis of data analysis was 
on (a) finding the general strategies used 
by expert catalogers so as to identify the 
mental models used during the process, 
(h) problem identification, and (c) discov- 
ering other issues encountered by the ex- 
pert catalogers in the cataloging process. 
The rest of this paper demonstrates how 
verbal reports were used to collect infor- 
mation on cataloging tasks and presents 
some preliminary findings of the project. 

What's in Verbal Reports 

Two verbal reports are given here to ex- 
emplify the use of verbal reports and how 
they can provide a glimpse into the mental 
processes of experts. They capture a typi- 
cal amount of complexity encountered by 
expert catalogers in the course of this 
study. For the purpose of this paper, the 
first cataloger is assigned the random nu- 
merical code 165 and is described as fe- 
male, while the second is assigned 606 and 
described as male. 

Analysis of a Self-administered 
Verbal Report 

The first verbal report by Expert 165 was 
conducted as a self-administered verbal 
report that describes the steps involved in 
the process of descriptive cataloging for 
one item (the coded original report is 
given in figure 1). What story does this 
verbal report tell? For one thing, Expert 
165 is a descriptive cataloger who per- 
forms only descriptive cataloging on her 
job. The verbal report itself does not de- 
scribe the context in which the protocol 
occurred. However, observations of the 
routine process of descriptive cataloging 
at LC during this project helped the 
author establish the setting for this case. 
As in most cataloging settings at LC, Ex- 
pert 165 chooses a book with the anticipa- 
tion of finding not only the book but also 
a printout of the preliminary descriptive 
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(1) Any special information on slips stuck in book? 

(2) No 

(3) Is a personal author metioned somewhere 

(4) (Notont.p.) 

(5) No 

(6) Title on cover 

(7) but no note, 

(8) as not different proper. 

(9) Ned. Economics Research Group established? 

(10) Yes 

(11) What is "conducted for: master report"? 

(12) Leave as is 

(13) Make a.e. for "contemporary pediatrics"? 

(14) (a serial) 

(15) Yes 

(16) Begin on-line work, 

(17) working from top of screen to bottom 

(18) Add code & date to 955 

(19) Proofread 245 

(20) nothing to add or change 

(21) 260 .. 

(22) 300 doublecheck "leaves," 

(23) not "pages" 

(24) no no. prelim, p. 

(25) Adda.e.s 

(26) Look at Fixed fields, 

(27) checking esp. boxes 20, 21, 23 

(28) Big Question. 

(29) Is there one big tide or title plus subtitle? 

(30) I decide to leave as is & choose latter. 

Figure 1. Coded Original Script of Verbal Report by Expert 165 



cataloging record created by a preliminary 
cataloger in another division, and possibly 
a slip indicating any problems the prelimi- 
nary cataloger has identified but is not 
authorized to solve. The expert works at a 
computer workstation with all the neces- 
sary descriptive cataloging tools, such as 
the Anglo-American Cataloguing Rules, 
second edition (AACR2) and LC's De- 
scriptive Cataloging Manuals. These are 
standard tools on each cataloger's desk 
and are consulted by the cataloger when 
specific questions arise. 

Expert 165 began her work on this 
book by checking whether the preliminary 
cataloger indicated any problem that 
needed her attention before she pro- 
ceeded; this is typically noted on a special 
slip stuck in the book. Not finding any 
such slip, she proceeded to examine the 



tide page. The question in Step 3 was very 
likely triggered by the potential applica- 
tion of AACR2 rule 21.1B1, 21.4A and 
21.4B, in which the cataloger is to deter- 
mine if there is a corporate body involved 
on the title page. The action, in turn, is 
probably triggered by her noticing a cor- 
porate body on the title page, although 
this was not documented in the verbal 
report. The answer in Step 4 shows that 
she did not find a personal name on the 
tide page. This answer in Step 4 triggered 
the decision made in Step 8. 

Instead of continuing the process of 
establishing the Statement of Responsi- 
bilities, Expert 165 at this point decided 
to keep her attention on the bibliographic 
data on the tide page. She compared the 
tide on the cover with that on the title 
page. She immediately decided that there 
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was no need to create a note. This was 
based on the AACR2 rules governing use 
of notes to indicate a different cover title 
if one exists; Step 8 gives an explanation 
of AACR2, rule 2.7B4. Step 9 indicates 
another decision point triggered by LCs 
policy of establishing an authority record 
in the LC authority file for each corporate 
body encountered. A search into the LC 
Name Authority File (LCNAF) was con- 
ducted before the decision in Step 10 
could be made, although the search was 
not reported in this verbal report. 

Step 11 indicates that the expert con- 
tinued her examination of the title page, 
as she found some special problems. Two 
problems were identified. One is the 

"contemporary pediatrics" in Step 13. It is 
unclear from the self-administered verbal 
report what the cataloger did between 
Steps 11 and 12 that led her to the deci- 
sion of Step 12. Nor is it clear what sug- 
gested to tier the possibility that the 
phrase "contemporary pediatrics" could 
indicate a serial, as noted in Step 14 and 
her answer in Step 15 that the phrase is a 
serial title related to the book, therefore 
requiring an added entry. 

Up to Step 15, Expert 165 concen- 
trated her attention on the item at hand 
and the printout of the preliminary de- 
scriptive cataloging record. A step not re- 
corded in this verbal report between Steps 

15 and 16 is the process of retrieving the 
preliminary record for this book from the 
Multiple-Use MARC System (MUMS) 
catalog for editing. Beginning with Step 

16 (i.e., once the record is located and 
displayed on screen), the cataloger turned 
her attention to the online screen. Step 17 
describes the workflow that follows the 
screen display. Step 18 results from the 
LCs internal administrative routine, 
which requires all catalogers to identify 
themselves and date each record in Field 
955 as an integral part of the process. 
Most catalogers do so as the initial step 
when they create or edit a record on 
screen. 

Because Expert 165 worked on an ex- 
isting record, the main process was proof- 
reading bibliographic data in fields, as in- 



dicated in Step 19. The word leaves in 
field 300 caught her eye in Step 22 be- 
cause it is a term that deviates from the 
common pagination method, as indicated 
in the explanation in Step 23. Preliminary 
pages present a problem in many descrip- 
tive cataloging cases, thus warranting spe- 
cial attention in Step 24. Once Expert 165 
finished adding the added entry for the 
serial title, she had completed biblio- 
graphic description in all variable fields of 
the record. She then turned her attention 
to fixed fields (Step 26) and as most de- 
scriptive catalogers do at LC, checked es- 
pecially fixed-field boxes 20, 21, and23 for 
publication date, language, and geo- 
graphic code. 

One would think that Step 27 com- 
pleted the process of descriptive cata- 
loging. But in this case, Expert 165 went 
back to the item and identified another 
problem that was not indicated earlier 
in the verbal report: How to interpret 
the title? The question at hand was 
whether the book has a long title or a 
main title with a subtitle. Expert 165 did 
not consult the tools or rules, nor was 
there any evidence that a colleague was 
consulted. Although AACR2 rule LIB 
group deals with the transcription of ti- 
tle proper, no such rule is applicable in 
this circumstance, nor does any text- 
book exist that addresses the interpreta- 
tion of bibliographic data on title pages. 
Catalogers must, as Hagler (1991) sug- 
gests, rely on their own bibliographic 
judgment in similar cases. This is evi- 
dent in the decision made in Step 30, 
where the expert must use her judgment 
in interpreting the title. Although the 
expert first paid attention to the title in 
Step 6, the question of judgment and 
interpretation (i.e., main versus subti- 
tle) was not raised until Step 29. 

Was the problem of main versus sub- 
title discovered upon completing the 
work of descriptive cataloging? Or was 
the problem identified during the title 
examination in Step 6 and simply stayed 
in the catalogers mind until all other, 
less tricky details were taken care of in 
the record? The answer is not appar- 
ent from the self-administered verbal 
report. 
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1. Check if it is duplicate 

2. edit Field 260 (publication and distribution, etc area) and fixed field information 
[no 300 for cip rec] 

3. back to 245 (title and statement of responsiblities area), wonder out loud about the 
subject 

4. fill in 100 (main entry, personal names) without checking the name authority file 
3. fill in a note in Field 504 

6. browse the table of contents and other preliminaries 

7. fill in Field 020 (ISBN), check the validity of ISBN 

8. check Subject Cataloging Manual for theological heading 

9. check name authority file for 100 heading [ok?] 

10. browse other works by the author 

1 1 . check other works with title "English enlightenment", consult 650 of some of the 
records 

12. read summary, comparing 650 (subject headings) headings with summary, 

13. browse table of contents and the list of illustrations 

14. read acknowledgement to see if other thinkers are involved 

15. decide to drop "Heaven and hell" as a subject heading, and adopt the two from the 
other heading 

16. add fixed information for Field 043 (geographic code) 

17. add two more subject headings for England — Intellectual life 

18. search the LC online catalog, MUMS by subject heading using the command: find 
afterlife 

19. search for subject authority record for the heading: Future life 

20. read all the headings and notes in 4xx and 5xx 

21. note the class number "BT899 or so" 

22. find s Future doctrines; use f = bo command to limit the search to books 

23. browse the list, display a few records and their subject headings, thinking about 
"Christianity" as a subdivision 

24. find s enlightenment, consult subject authority record, sh85-44032 

25. nccs. Delete the 2 SHs for England— Intellectual life. Change them to Enlighten- 
ment — England 

26. correct a subfield code in Field 650 (subject heading) 

27. browse the summary again 

28. recall the record using "nccs" command and read the screen 

29. check the index of classification schedule, BT, for Future state. Future life. 

30. look at the page for BT899 

31. use General works. 1951-. pcrd to proofread 

Figure 2. Coded Script of the Verbal Report by Expert 606 



Analysis of a Think-aloud Protocol 

The second verbal report represents a 
typical case of a protocol interview in 
which the expert cataloger was asked to 
catalog an item while thinking aloud along 
the process. (See figure 2 for summary 
notes of the think-aloud protocol). Expert 
606 is a whole-book cataloger who has 
been trained to conduct both descriptive 
and subject cataloging of the same item 



under LC's whole-book cataloging pro- 
ject, which started in early 1990s. As the 
protocol interview began, the cataloger 
spent some time explaining his strength in 
descriptive cataloging from his many years 
of experience and that he had only in 
recent years been involved in subject cata- 
loging. Because of his background and 
recent changes in the whole -book catalog- 
ing policy on the job, he tended to ap- 
proach cataloging with special attention 
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on subject analysis, a new focus of learning 
for him. 

As with the analysis of the first verbal 
report above, some information about the 
cataloging setting is in order before the 
analysis of this verbal report begins. In 
this case, Expert 606 was conducting both 
description and summarization with the 
purpose of creating a cataloging-in-publi- 
cation (CIP) record for a galley proof sub- 
mitted by a publisher who intended to use 
the CIP record upon printing of this book. 
The galley proof included all preliminary 
pages and the beginning chapter of the 
book. The interview took place in a cubi- 
cle containing cataloging workstation. Ex- 
pert 606 had the galley proof pages and 
the copyright registration sheets submit- 
ted along with the galley proof by the 
publisher. Unlike in the previous case, no 
preliminary record for this item existed 
prior to the interview. 

The first steps Expert 606 took were 
to determine whether this item fell into 
the subject scope of the cataloging 
team — i.e., religion, psychology and 
philosophy — and whether it was a dupli- 
cate. Once those two administrative 
questions were answered, the cataloger 
called up an empty workform on the 
screen and began to input bibliographic 
data into field 260 (publication, distri- 
bution, etc.) and related fixed field 
boxes. He indicated that there would be 
no field 300 (physical description) since 
this would be a CIP record. Once bibli- 
ographic data related to publisher and 
publication were completed on the 
screen workform, the cataloger turned 
his attention to field 100 (main entry, 
personal name) and filled in the author's 
name according to his knowledge of 
AACR2 chapter 24. He did not check 
the name in the LC Name Authority 
File first. Data for the bibliographic 
note in field 504 were provided as the 
next step. Upon finishing that, Expert 
606 browsed the table of contents and 
the preliminary pages to see what the 
book was about. In doing so, he encoun- 
tered the ISBN number and immedi- 
ately filled in the ISBN data in field 020 
and checked its validity. 

As Expert 606 browsed the table of 



contents and added some possible subject 
headings to 650 fields (subject headlings) 
for this item, he checked LC's Subject 
Cataloging Manual for theological head- 
ings. Not finding anything particular, he 
searched the personal name in the 
LCNAF to verify the form of heading in 
field 100. To do so, he switched to the 
MUMS cataloging system, searched the 
author's name, and found some of the 
author's works with the phrase "English 
enlightenment" either in the titles or in 
the subject headings. He proceeded with 
a title search using the phrase and con- 
sulted the headings in the 650 fields of 
those items found in this search. 

Not satisfied with the subject headings 
he had on his workform, Expert 606 re- 
turned to the item in hand. He read the 
the summary provided by the publisher on 
the copyright registration sheets and con- 
sidered some of the headings found in the 
above title search. At this point, the cata- 
loger browsed the table of contents again 
and read through the list of illustrations. 
He also read the acknowledgments to see 
if names of other thinkers were men- 
tioned. Upon doing so, he decided to drop 
one heading and added two other head- 
ings. A quick switch from subject catalog- 
ing to descriptive cataloging and back to 
subject cataloging occurred when Expert 
606 added the fixed information for field 
043 (geographic code). Upon returning to 
subject cataloging work, he added two 
more subject headings related to "Eng- 
land-Intellectual life." He then searched 
the MUMS catalog for the subject head- 
ing "Afterlife," and also searched LC's 
Subject Authority File for "Future life" 
and read all the headings and notes in 
Fields 4XX and 5XX. As he did that, he 
noted the class number to be "BT899" and 
recorded it in field 050 (LC call number) 
of his workform. 

The cataloger further searched other 
items with the subject heading "Future 
doctrines," browsed the resulting list, and 
displayed a few records. As a result of this 
browsing, the cataloger began to consider 
adding "Christianity" as a subdivision to 
the subject heading. Another subject 
search was conducted to find the subject 
authority record for the heading "Enlight- 
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enment." Upon finishing reading the sub- 
ject authority record, die Expert modified 
the subject headings he established ear- 
lier on the screen workform by deleting 
the two subject headings for "England — 
Intellectual life," changing them to "En- 
lightenment—England." He also cor- 
rected a subfield code in one of the 650s 
he had used earlier and browsed the sum- 
mary of the copyright registration sheets 
again. 

At this point, Expert 606 read the en- 
tire workform one more time and was 
satisfied with what he saw. He then turned 
his attention to assigning the classification 
number. He checked the classification 
schedule BT under the index for "Future 
state. Future life," looked at the page for 
BT899, and finally decided to use "Gen- 
eral works, 1951- ." Classification work 
done, Expert 606 saved the record and 
called it up again on the screen to proof- 
read it. 

Mental Processes 

The above description nf the two verbal 
reports collected in this project at LC 
raises the question, What do the verbal 
reports tell us about the mental processes 
of experts involved in the cataloging proc- 
ess? Before answering this question, one 
should begin by noting that the two expert 
catalogers reported here have very differ- 
ent mental models even though they both 
conduct descriptive cataloging at the 
same institution under the same catalog- 
ing policy guidelines. 

General Strategies 

In terms of general strategies. Expert 165 
exemplifies the common understanding 
of the cataloging process among educators 
and practitioners in the field. Her catalog- 
ing process follows the typical flow of 
working on a workform (in this case the 
printout provided by the preliminary cata- 
loged in a top-down manner beginning 
with main entry. Initially she spent time 
interpreting the item's bibliographic data, 
then moved on to the development of a 
draft record on the printout before she 
finally went to the computer to actually 



edit the screen workform. The workflow 
of Expert 165 largely begins with determi- 
nation of access points, moving on to 
authority work, providing description, and 
finally editing trie record. 

Expert 606, on the other hand, concen- 
trated on the task of subject analysis 
throughout his protocol (which he be- 
lieved was not his strength) and com- 
pleted the routine tasks (such as filling out 
the descriptive fields) along the way. In 
many cases, the bibliographic data be re- 
corded in tie descriptive fields were used 
to a great extent in his research work for 
subject analysis for the item. While no 
defining workflow appears in his catalog- 
ing process, there was a clear, consistent 
theme to his cataloging process: subject 
analysis, with every other cataloging task 
for the item fit in around the theme. In 
comparison with Expert 165, Expert 606's 
descriptive cataloging workflow largely 
begins with providing description (ISBD 
area 4, publication and distribution, etc., 
area) before moving on to determining 
access points. For Expert 606, unlike Ex- 
pert 165, creating and editing the screen 
workform is an ongoing process, not a 
separate step at the end. 

Problem Solving 

To a certain degree, the two expert cata- 
loged are similar in their approaches to 
problem solving. Both experts ruled out 
problems of an administrative nature 
(such as whether a specific book falls into 
the scope of their team) early in the proc- 
ess, but when it comes to problems of a 
substantial nature (such as interpretation 
of bibliographic data or matching the 
scope of subject headings with the topical 
themes of the item), the two experts dif- 
fer. Expert 165 noted the problem of in- 
terpreting potential components of the 
tide at the end of the session only after all 
other tasks were completed, and appeared 
reluctant to make personal judgements 
during the process without giving herself 
time to think or to consult with others. 
This strategy, although it kept the expert 
free from distraction in the process, does 
carry the risk that she might simply forget 
to make a decision on this item. Taking a 
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different approach, Expert 606 made the 
special problem the central theme of his 
process and tried several alternative 
methods to reach his own satisfactory con- 
clusions. Even when confronted with the 
need to verify the name authority form for 
the personal author, Expert 606 simply 
filled in Field 100 with what he consid- 
ered to be the correct form of heading and 
only later returned to verify the form in 
the LCNAE 



The Role of the Screen Workform 

One particularly interesting aspect in ana- 
lyzing the verbal reports of the two experts 
is the way in which they use the cataloging 
workform on the computer screen. A 
screen workform is an empty or incom- 
plete cataloging record with necessary 
MARC tags into which bibliographic data 
are added and edited to create a catalog- 
ing record for an item. The workform is 
the basis of the end-product in the cata- 
loging process. Calling up the screen 
workform for the item at hand after she 
had verified all routine bibliographic data 
needed for description, Expert 165 ap- 
peared to treat the workform as some- 
thing much closer to what one might call 
the end-product. Her verbal report sug- 
gests a formality to her process in which 
enough preparation must be done before 
proceeding with dealing with the screen 
workform. 

This is absolutely not the case for Ex- 
pert 606, who called up a new workform 
the moment he sat down with the item and 
began filling in bibliographic data without 
much preparation. In many cases, the data 
in descriptive fields appeared incomplete 
or unverified until he went back a second 
time. Potential subject headings for the 
item were recorded into 650 fields as they 
were discovered at various times of the 
protocol interview, only to be deleted or 
modified later. The screen workform ap- 
peared to serve the same function as a 
blackboard on which he sketched out the 
blueprint of the cataloging record and 
changed his sketches as his thinking 
evolved. The screen workform did not be- 
come the actual end-product of a biblio- 



graphic record until he saved it and called 
it up again for proofreading. 

Potential Hypotheses 

Based on the forgoing discussion, I offer 
some hypotheses on the mental processes 
and the expertise of catalogers. 

The first is related to the cataloging 
record. Some expert catalogers appar- 
ently follow the traditional concept that a 
cataloging record is regarded as the end- 
product of the cataloging process and 
therefore tend to formalize the steps of 
creating and editing cataloging records 
only after a certain level of preparation is 
done. Other expert catalogers view a cata- 
loging record as a workspace that can be 
used to draft their ideas and store their 
work progress; they consider the data in 
the record to be subject to constant 
change without any fear of losing the in- 
tegrity of the cataloging record. One 
would think that the latter type of expert 
might be more open to changing biblio- 
graphic records even after they reach users. 

Two issues related to this require fur- 
ther investigation. One is whether expert 
catalogers favor one model over the other. 
The other concerns the implications this 
hypothesis has on the common institu- 
tional practice among many cataloging 
systems regarding whether and how an 
error found in an existing record is cor- 
rected and who is authorized to do the 
correction. 

The second hypothesis has to do with 
the free use of association to build one's 
own cataloging expertise, as seen in the 
second verbal report. Since Expert 606 
perceived subject analysis as not one of his 
strengths (even though he possessed a few 
years of experience in it and might be 
considered an expert in that area by many 
people), he took the liberty of using what- 
ever bibliographic data he could find to 
research the appropriateness of subject 
headings and to improve the degree of 
scope-match between the subject head- 
ings and the topical themes of the item. 
Data he used in networking and associa- 
tion in his protocol included (a) the 
authors name, (b) the author's other 
works, (c) other scholars' names associ- 
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ated with the author by virtue of their 
appearance in the acknowledgment, and 
(d) works that share similar topical terms, 
among others. This networking and asso- 
ciation strategy has proven to be a very 
powerful tool for learning and self-im- 
provement in cataloging. 

The third hypothesis offered here is 
based on the observations in both verbal 
reports suggesting that certain cataloging 
tools were not utilized in the experts' cata- 
loging process as often as one would think. 
Expert 165, for example, appeared so con- 
fident in her knowledge of rules and tools 
that the use of rules and tools was never 
mentioned in her verbal report. Even 
when she noted the special problem of 
interpreting parts of the title at the end of 
her report, she made no attempt to check 
rules or local policy documentation to see 
if anything could help her decision. The 
only tool she used during the process was 
the Name Authority File. Expert 606, on 
the other hand, make extensive use of 
tools, including the Name Authority File, 
Subject Authority File, MUMS catalog, 
and the Subject Cataloging Manual. This 
leads to a possible hypothesis that catalog- 
ing tools are really of two kinds — the for- 
mal tools, such as AACB2 and Library of 
Congress Classification systems, and the 
contextual tools, which are specific to the 
cataloging end-products within a particu- 
lar institution — and that the formal tools 
are used primarily for training, and the 
contextual primarily for local practice. 

Conclusion 

This paper demonstrates that the use of 
verbal reports is a valuable technique in 
in-depth studies on the quality of catalog- 
ing expertise. As many researchers and 
practitioners alike struggle to teach cata- 
loging, to explain its professionalism, to 
train new catalogers, and to improve their 
own acquisition of cataloging knowledge 
and skills, the analysis of verbal reports, 
such as done here, can provide critical 
insights into the general strategies, mental 
models, and problem-solving skills of 
cataloging. Further analysis of the data 
gathered should offer specific proofs to 
test the three hypotheses described above 



and better understanding of the mental 
processes and expertise in cataloging. 
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Use Studies: A Selective Review 



Nancy J. Butkovich 

Librarians have conducted hundreds of studies exploring various aspects of 
collection use in libraries. Most studies are of journal collections in academic 
libraries; however, the principles of conducting use studies are generally 
applicable to other materials and other types of libraries. Use studies can be 
conducted in a wide variety of ways, and they can measure different aspects 
of the use of a coUection. Each method has its own particular strengths and 
weaknesses. If a combination of methods is used, the weaknesses of each 
method can be offset by the strengths of the others, and a truer picture of 
overall use can then be obtained. 



JLibrarians have conducted hundreds of 
studies exploring various aspects of collec- 
tion use in libraries (Millson-Martula 
1988). Most of the works reviewed in this 
article are about studies of journal collec- 
tions in academic libraries; however, the 
principles of conducting use studies are 
generally applicable to other materials or 
types of libraries. In its broadest sense, 
use is defined as "whether and/or how 
often a book, periodical, or segment of the 
collection is used" (Christiansen, Davis, 
and Reed-Scott 1983, 434). In practice, 
however, there is no agreement on what a 
"use," (Broadus 1985a; Metz and Litch- 
field 1988; Rice 1979) let alone "low use," 
really is; the definitions vary according to 
local needs (Millson-Martula 1988). 

A use study is any method of data re- 
trieval that answers, or helps to answer, 
basic questions regarding the acquisition, 
storage, and retention of materials in the 
collection. There are many different types 
of use studies, and each has certain strengths 
and weaknesses. Nonetheless, librarians 
continue to conduct them in an effort to 
manage various aspects of their collections. 



In this paper, I will take the broad view 
of what constitutes a use study. I will re- 
view a variety of different methods that 
have been discussed in the literature. 
These include core lists and opinion sur- 
veys, reshelving studies, patron observa- 
tion, circulation studies, interlibrary loan 
and other form-based requests, citation 
analyses, and impact factors. The meas- 
urement of non-use of collections will also 
be examined. This paper will conclude 
with a mock use study that applies many 
of the different methods discussed in this 
paper. 

Use studies are conducted for a variety 
of reasons. One of the most common 
given is to aid in deciding which serial 
subscriptions could be cut (for example, 
Alldredge 1983; Chrzastowski 1991; 
Evans 1990; Milne and Tiffany 1991b; 
Naylor 1990; Veenstra and Wright 1988). 
Other reasons include adding new titles 
(Evans 1990), determining a need for du- 
plicate subscriptions (Naylor 1990; Veen- 
stra and Wright 1988), transferring mate- 
rial to storage locations (Christiansen, 
Davis, and Reed-Scott 1983; Fjallbrant 
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1984; Harris 1977; Rice 1979; Taylor 
1976-1977; Veenstra and Wright 1988) or 
withdrawal of materials (Fjallbrant 1984; 
Harris 1977; Rice 1979), and justification 
of previous serial cancellations (Bustion 
and Treadwell 1990). Data may also be 
used to determine which titles are essen- 
tial, and the distribution of collection de- 
velopment funds may be based on use 
data. In addition, use studies can identify 
who is using the collection as well as what 
is being used (Christiansen, Davis, and 
Reed-Scott 1983). 

Just as there are different reasons for 
conducting a use study, there are also a 
variety of problems associated with them. 
Some of the more commonly mentioned 
ones include staffing requirements (Millson- 
Martula 1988), the expense of running the 
survey, and questions concerning methodol- 
ogy and validity (Broadus 1985a; Millson- 
Martula 1988). There is often concern that 
quantitative measures alone do not accu- 
rately reflect use. "Subjective factors, such as 
value or relevance to the curriculum ..." 
(Millson-Martula 1988, 128) are also impor- 
tant. 

Patrons might not cooperate with use 
studies, and might actively try to bias the 
survey results (Milne and Tiffany 1991a; 
Naylor 1994). They can also unintention- 
ally distort results. For example, in 
reshelving studies using the sweep 
method, the materials that users reshelve 
themselves are not included in the final 
count, resulting in an underreporting of 
actual use (Broadus 1985b; Naylor 1993; 
Naylor 1994). 

Information use patterns vary among 
disciplines (Metz and Litchfield 1988; 
Naylor 1990), and information formats 
differ in the way they are used (Metz and 
Litchfield 1988). The number of people 
working locally within a discipline should 
also be considered (Naylor 1990). Single- 
faceted use studies cannot measure total 
use. Instead, as was noted about reshelv- 
ing studies, they measure some subset of 
total use (Rice 1979). Consequently, mul- 
tiple approaches to use studies are better 
because they allow the librarian to get a 
more complete picture of the whole than 
would be possible if only one method 
were employed. 



Authors often disagree, however, 
about the relative value of a particular 
method. For example, Broadus states that 
"If proper allowances are made, counts 
based on the JCR [Journal Citation Re- 
ports] can be almost as good as expensive 
local studies for predicting use of peri- 
odicals in a given library" (1985a, 33). On 
the other hand, Line declares that "no 
measure of journal use other than one 
derived from a local use study is of any 
significant practical value to librarians" 
(1978,315). 

Use studies vary considerably in their 
duration. Some circulation studies last 
just a few days. In an effort to determine 
the shortest reasonable time length for a 
circulation study, Mete and Litchfield 
conducted a study that utilized sets of data 
gathered at two different times several 
years apart. In the first interval, they ex- 
amined all the materials circulating on a 
particular day. They also examined circu- 
lation over a period of several months. 
After comparing the results, they con- 
cluded that three days was probably the 
shortest duration for a reasonably repre- 
sentative circulation study, provided that 
the sample size was sufficiently large 
(Metz and Litchfield 1988). A similar con- 
clusion was reached by Bulick, Sabor, and 
Flynn (1979). 

Some of the most common studies are 
reshelving studies of various types. A fairly 
common, though by no means universal, 
time length is one year (Alldredge 1983; 
Gossen and Irving 1995; Milne and Tif- 
fany 1991a, 1991b; Naylor 1990; Schmidt, 
Davis, and Jahr 1994). However, a circu- 
lation study of monographs at the Univer- 
sity of Pittsburgh lasted more than seven 
years (Bulick, Sabor, and Flynn 1979; 
Kent 1979). Longer time lengths have a 
major advantage over shorter ones, at 
least in academic institutions, because 
they even out variations in use caused by 
the academic calendar (Milne and Tiffany 
1991b; Naylor 1990; Schmidt, Davis, and 
Jahr 1994). 

Line and Sandison warn that "ranked 
lists of crude 'uses' are valueless" (1975, 
393). They state that librarians should 
consider "how many uses per monetary 
unit each journal provides [and] . . . 
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the number of uses per unit of shelf space 
..." (Line and Sandison 1975, 393; italics 
in original). Several authors have incorpo- 
rated, or at least considered, one or both 
of these concepts in their work (for exam- 
ple, Gossen and Irving 1995; Rice 1979; 
Rooke 1990). 

Veenstra and Wright noted "a signifi- 
cant inverse relationship between the size 
of a library periodical collection and the 
percentage of the journal collection that 
may be expected to receive use" (1988, 
171). The same observation was also made 
by Flynn (1979). Intuitively, however, this 
seems logical, because smaller collections 
would probably have a heavily-used core 
collection and very few marginal titles. A 
larger collection, simply because it is 
larger, would probably have the same 
heavily used core, but also have a higher 
percentage of the titles that are outside 
the core. 

Core Lists and Opinion Surveys 

Although core lists do not measure use, 
they do give an indication of the impor- 
tance of a given title to some individual or 
organization. Titles ^pearing on these 

to institution. Line noted that "A glance at 
the list of the most requested journals 
[from the British Library Lending Divi- 
sion] shows that they are all high-status, 
high-use, commonly held journals" (1978, 
313). 

There are different types of core lists. 
For example, accrediting agencies might 
have a list of required or recommended 
titles that they expect to see in libraries 
supporting departments or institutions 
wishing to receive or to maintain accredi- 
tation (Millson-Martuk 1988). The 
American Chemical Society (ACS) is a 
good example of this. The ACS has a list 
of recommended and required serials that 
it deems necessary to support an under- 
graduate chemistry curriculum (Ameri- 
can Chemical Society 1993). 

Within an academic institution there 
are also core lists that have been prepared 
internally and consist of lists of titles con- 
sidered to be essential for teaching or 
research. These are generally produced 



by polling faculty (Bustion and Treadwell 
1990; Schmidt, Davis, and Jahr 1994). In 
one study the core lists were prepared 
using opinion surveys prepared by the fac- 
ulty, who were asked to list the tides they 
felt were most important. When the re- 
sults were compared with data obtained 
from other studies based on citation and 
circulation data, the investigators found 
that virtually the entire core list appeared 
in one or the other of the two studies 
(Schmidt, Davis, and Jahr 1994). Some- 
times core list polls are included in ques- 
tionnaires that cover "all aspects of peri- 
odical use of the library" (Ambia 1991). 

In other cases faculty were presented 
with a list of titles and asked to assign a 
value measure to them (Bustion and 
Treadwell 1990; Fjallbrant 1984; Naylor 
1990). These studies generally confirmed 
that low-ranked titles on faculty surveys 
were seldom used in reshelving studies 
(Bustion and Treadwell 1990; Fjallbrant 
1984). The authors of one study also found 
that there was very little correlation be- 
tween the faculty-generated lists of essen- 
tial tides and the reshelving data (Bustion 
and Treadwell 1990). 

Some opinion studies are based on the 
professional judgment of librarians rather 
than the academic faculty. In one study 
librarians considered "language of publi- 
cation, to see whether it was a language 
taught on campus; whether the journal 
was indexed and if the indexes were held 
in the library; and the appropriateness of 
the title to die curriculum" (Swigger and 
Wilkes 1991, 43). In another study in 
which some academic departments chose 
not to rank titles, librarians developed 
cancellation lists based on "their best 
judgment" (Bustion and Treadwell, 1990, 
43). In a study described by Broadus, 
White concluded "that the subjective 
judgments made by librarians have in gen- 
eral been correct in regard to what sub- 
scriptions should be discontinued" 
(Broadus 1985b, 58). 

Opinion studies produce results that 
might be of questionable value because 
the motives of the people producing the 
lists are unknown. Also, various groups 
prepare lists in different ways. Therefore, 
the level of participation by individuals 
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within a group is uneven (Swigger and 
Wilkes 1991). Care should be taken that 
the number of people surveyed is large 
enough to produce valid results. The same 
statement also applies to the number of 
people who respond to a survey (Veenstra 
and Wright 1988). Patrons might also in- 
correctly remember which journals they 
use (Broadus 1985b). Use by researchers 
and students in other areas should be con- 
sidered, because users outside a given dis- 
cipline could have different needs than 
users within (Greene 1993). Nonetheless, 
opinion studies, particularly those based 
on faculty responses, are often an impor- 
tant, and in some cases, the only basis used 
by librarians to make collection develop- 
ment decisions (Milison-Martula 1988). 

Reshelvtng Studies 

Reshelving studies are popular for gather- 
ing use data, and the use of both bound 
and unbound journals have been analyzed 
using them (Chrzastowski 1991; Milne 
and Tiffany 1991b; Naylor 1990, 1993, 
1994). 

There are two broad types: sweep stud- 
ies and check-off studies. The sweep 
method measures what patrons take off 
the shelf and leave for library staff to 
count and reshelve (Ambia 1991; Evans 
1990; Konopasek and O'Brien 1984; Nayl- 
or 1990, 1993, 1994). The check-off 
method requires patrons to tick off each 
use of a volume or issue on some sort of 
tally sheet or sticker attached to the covers 
of the items being surveyed (Konopasek 
and O'Brien 1984; Milne and Tiffany 
1991a; Naylor 1993, 1994). 

In some cases items were found that 
had been misshelved or otherwise dis- 
turbed. These were often included in 
reshelving results (Alldredge 1983; Evans 
1990; Konopasek and O'Brien 1984; Nay- 
lor 1993), as were titles that had been used 
for interlibrary loan (Evans 1990; Fjall- 
brant 1984). 

Both methods have their weaknesses. 
The sweep method requires an invest- 
ment of staff time to record the data. It 
does not record use where patrons 
reshelve the materials themselves (Naylor 
1993, 1994). Depending on the local cir- 



cumstances this can be a significant por- 
tion of the total use. Two reshelving stud- 
ies using the sweep method yielded re- 
sults representing only 20%-25% and 
40% respectively of the total use (Taylor 
1976-1977), while a third reported an av- 
erage of 19 uses in which material was 
reshelved by patrons for every item left 
for library staff to reshelve. This under- 
counting varied by discipline (Harris 
1977). Still another noted that "In all cases 
of use for less than ten minutes, the jour- 
nal was reshelved [by the patron]" 
(Wenger and Childress 1977, 294). Fi- 
nally, this method does not take into ac- 
count how patrons used the materials. 
"Whether that happened because some- 
one looked at the table of contents, read 
one article, or read the whole issue re- 
mains unknown" (Swigger and Wilkes 
1991, 42). 

In theory the check-off method elimi- 
nates, at least in part, these weaknesses, in 
that it puts the onus of data recording on 
the patron instead of the library staff. In 
practice, however, users often did not re- 
cord the use (Naylor 1993, 1994). Also, 
patrons sometimes appeared to inflate use 
by making multiple ticks for a single use 
(Naylor 1994). 

In studies of the same collection using 
the two methods, the sweep method pro- 
duced use levels at least 40% higher than 
those obtained by the check-off method 
(Naylor 1993; Naylor 1994). In another 
study, researchers checked reshelving 
data obtained using the check-off method 
and determined that the check-off 
method underreported actual use by one 
third (Milne and Tiffany 1991a, 1991b). 

Non-Use Studies 

Although reshelving studies usually regis- 
ter use, they can also be used to measure 
non-use of a collection. 

Non-use studies are relatively simple 
to conduct (Alldredge 1983; Rooke 1990), 
but they are susceptible to error. They do 
not attempt to determine why a title is 
seldom used. This method is either a yes- 
it s-used or no-it s-not-used method; it 
cannot accurately register multiple uses 
or identify how volumes are used (Rooke 
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1990). It can, however, indicate whether 
in-house materials were used and 
reshelved by patrons (Harris 1977). 

One such study utilized a variation of 
the check-off method, with a sticker on 
the cover of a current issue being 
checked-off when it was reshelved 
(Alldredge 1983). Other studies ad- 
dressed non-use of bound journals. This 
was often determined by markers inserted 
into volumes in such a way that anyone 
using a given volume would be forced to 
disturb the marker (Harris 1977; Rooke 
1990; Taylor 1976-1977). Sauer studied 
both "nonuse of current [journal] issues 
and nonuse of bound volumes and micro- 
films" (1990, 100). Over half of the titles 
with unused current issues also had un- 
used back runs. 

To establish a control, higher use titles 
are sometimes used (Rooke 1990; Taylor 
1976-1977). In both studies, researchers 
converted the raw data into an index num- 
ber using equations that compensated for 
different variables (Rooke 1990) or the 
amount of shelf space needed to house the 
title being surveyed (Taylor 1976-1977). 
Rooke figured use data and the size of a 
title's backfile into calculations that even- 
tually generated a cost-per-use figure. Al- 
though studies that approximate the den- 
sity of use can be valuable, they can be 
misleading because some titles can be 
high use titles yet still have low densities 
of use. Attempting to store or cancel these 
titles can have serious implications for the 
patrons (Wenger and Childress 1977). 

Circulation 

Circulation studies are useful because 
they can measure use, such as undergradu- 
ate use, that might not be reflected in other 
study techniques. They also can measure 
what is actually being removed from the 
library and which patron groups borrow the 
materials. Because the data are easy to ob- 
tain and because factors influencing the 
data, such as time length and amount of 
material used, can be controlled, the data 
can be manipulated and analyzed in a variety 
of different ways (Christiansen, Davis, and 
Reed-Scott 1983). 

Circulation studies fall into several 



broad categories. In one study, the author 
looked at what was actually checked out 
during a given time span (Chrzastowski 
1991). In some cases circulation figures 
also included reshelving data (Schmidt, 
Davis, and Jahr 1994). Other authors ex- 
amined the characteristics of everything 
that was in circulation at a given time 
(Metz and Litchfield 1988). Still another 
considered circulation history based on 
the dates that items circulated. Taylor 
considered any title that met the criteria 
set in his 15/5 Circulation Rule as a candi- 
date for remote storage. He defined this 
rule as "all volumes of that title which 
were published in the last fifteen years 
[and that] have not been borrowed during 
the last five years" (1976-1977, 38). 

In comparing circulation statistics with 
reshelving data, Metz and Litchfield 
(1988) found that circulation data re- 
flected in-house use fairly accurately. Oth- 
ers took this analysis a step further and 
noted that circulation data also mirrored 
interlibrary loan lending (Bulick, Sabor, 
and Flynn 1979). Neither variations in 
time nor different methods of analysis ap- 
peared to cause any major fluctuation in 
the data (Metz and Litchfield 1988), and 
a correlation, which varied by subject, 
seemed to exist between external circula- 
tion and internal reshelving data (Harris 
1977). 

Researchers at the University of Pitts- 
burgh were able to establish circulation 
histories for monographs added to the col- 
lection in the first year of the study (Bul- 
ick, Sabor, and Flynn 1979). Reshelving 
data was also used to check the circulation 
data. They found enough correlation to 
"conclude that in terms of whether or not 
a book or monograph is ever used, it is 
sufficient to examine the external patron 
circulation data" (29). 

Schad (1979), however, raised several 
objections to the Pittsburgh study. In cri- 
tiques relevant to circulation studies, 
Schad argued that not all circulation trans- 
actions are recorded in an electronic sys- 
tem, and that books may be used without 
being checked out. Christiansen, Davis, 
and Reed-Scott (1983), made these same 
observations in comments regarding cir- 
culation studies in general. 
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Generalizing Schad's objections, circu- 
lation studies measure past use; future use 
might be quite different as research areas 
change, and circulation based on instruc- 
tional use will be radically different from 
circulation based on research use (Schad 
1979; Voigt 1979). In cases where date 
due stamps are counted, undercounting 
can occur when items are checked out or 
reshelved but are not stamped (Harris 
1977). 

Patron Observations 

Not everyone takes library materials to a 
table or out of the library to use tbem. 
Many people, for various reasons, choose 
to use the items in the stacks, and they 
often reshelve the materials themselves. 
In either case the materials that they use, 
whether monographs or serials, do not get 
included in use studies based on reshelv- 
ing statistics. 

One method for obtaining information 
about materials reshelved by patrons is 
the unobtrusive study. In this method, pa- 
trons are observed and the number of 
items they use are counted, while the pa- 
tron remains unaware of the observer 
(Bustion, Eltinge, and Harer 1992; Ross 
1983). 

Like all other methods of measuring 
use, however, this too has its weaknesses. 
The observers need training in what they 
are to look for and how to interpret what 
they see. Another potential problem is 
that the observer often will be unable to 
identify specific titles being used, a prob- 
lem that does not affect other methods of 
determining use. Finally, cost is also a 
factor. The unobtrusive observation 
method is significantly more expensive to 
use than a reshelving study (Bustion, El- 
tinge, and Harer 1992). The results can be 
worth the effort, however. Ross noted that 
each patron observed during that study 
removed an average of 6.74 books and 
reshelved an average of 5.52 books (1983). 

Flynn (1979) used an obtrusive 
method that involved searching the jour- 
nal stacks for patrons using journals. The 
observer would then either interview pa- 
trons about their use or would request 
that the patrons complete a form concern- 



ing their use of the journals. Some prob- 
lems were noted with this approach. In 
some cases users refused to answer some 
survey questions. In other cases the infor- 
mation patrons provided did not fit in the 
categories on the forms. Also, some pa- 
trons left before the observer could con- 
duct the survey. 

Citation Analysis and 
Impact Factors 

Citation analysis is a method that analyzes 
the characteristics of references cited in 
published literature. Although Broadus 
(1985a) states that citation analysis is quite 
useful and sufficiendy accurate to replace 
local studies, several others remain un- 
convinced (Chrzastowski 1991; Naylor 
1990; Rice 1979; Scales 1976; Swiggerand 
Wilkes 1991). Swigger and Wilkes (1991) 
qualify their position by arguing that cita- 
tion studies could be very useful if they 
were used in conjunction with other 
methods. They also observe that smaller 
libraries, because they are less likely to 
support large and varied research pro- 
grams, would probably find the generic 
citation rankings to be more useful than 
large institutions. 

Certainly citation studies based on an 
entire citation index have well-docu- 
mented problems. Some of the most ob- 
vious are: only the first author of a cited 
work is listed; there is no authority control 
for author or journal names; some titles 
are so truncated as to be unusable; and 
citations by many patron groups are not 
included because their written output is 
not indexed (Schmidt, Davis, and Jahr 
1994). Also, many citations are omitted 
because the literature of some disciplines 
is not well represented (Broadus 1985a; 
Swigger and Wilkes 1991) and because 
only journals are used to produce the 
Journal Citations Report. Other formats, 
which also contain citations to bodies of 
work, are omitted (Scales 1976). There is 
also a possibility that "the citation rank- 
ings in JCR are of more use for American 
than for British libraries, but ... no firm 
conclusion of this sort can be drawn" 
(Scales 1976, 21). Citation patterns can 
vary within subject areas as well as across 
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subject boundaries. Time lag in various 
stages of the publication cycle can also 
influence citation data (Christiansen, 
Davis, and Reed-Scott 1983). 

On a more fundamental note, there are 
problems inherent in the citations them- 
selves. For instance, authors commonly 
use some types of materials that rarely get 
cited (Schmidt, Davis, and Jahr 1994), and 
"It is possible that some authors cite arti- 
cles they have never read .... [Also,] fac- 
ulty research interests may change, so past 
citations of a journal may not predict fu- 
ture use" (Swigger and Wilkes 1991, 44). 

Different user populations may use the 
same body of literature in different ways. 
For example, McCain and Bobick com- 
pared citations in faculty articles, student 
dissertations, and "qualifying briefs writ- 
ten by second-year students entering the 
Ph.D. program" (1981, 258). They found 
that, even though all three populations 
were related to each other, there were 
significant differences in the way each 
population used the same collection 
(McCain and Bobick 1981). 

An additional problem is that the 
author may not have used a library copy, 
even though the title is present on die 
library shelves (Swigger and Wilkes 1991). 
Also, libraries may not own everything 
cited by their users (Schmidt, Davis, and 
Jahr 1994). Intuitively, one suspects that 
this would not be true with citation studies 
of undergraduate papers, particularly be- 
cause undergraduates often do not have 
access to interlibrary loan facilities. In just 
such a study, Magrill and St. Clair (1995) 
made this assumption, because they saw 
no evidence to the contrary. 

Nonetheless, citation studies can be 
quite useful if these limitations are kept in 
mind. In an academic setting, they can 
identify heavily used titles, provided that 
"undergraduate use is not ordinarily 
heavy, or if most users come from the 
primary constituency of the library" 
(Schmidt, Davis, and Jahr 1994, 63; un- 
derlining in original). Even when using 
online citation indexes, one can target that 
"primary constituency" by limiting the 
study to users within a specific location or 
zip code. Studies of online citation in- 
dexes have been an integral part of journal 



collection development in the Physical 
Sciences Library at Penn State for several 
years. SCISEARCH has also been suc- 
cessfully used for local citation data by 
working with the corporate source field 
and then analyzing the citations appearing 
in the articles retrieved (Green 1993). 

Collection use by undergraduates is 
not reflected in citation studies based on 
the journal literature, yet undergraduates 
constitute the largest patron population in 
academic libraries. In an effort to under- 
stand use patterns of this critically impor- 
tant patron category, Magrill and St. Clair 
(1995) did a citation analysis of under- 
graduate papers from four academic insti- 
tutions — two universities having an em- 
phasis in scientific and technical research, 
and two church -supported liberal arts col- 
leges. They found that science students 
listed approximately two times the num- 
ber of references in their papers as hu- 
manities or social sciences students. Also, 
nearly two-thirds of the references listed 
by science undergraduates were to journal 
articles, while humanities undergraduates 
used approximately the same percentage 
of books. Social sciences students used 
journals at a slightly higher rate than hu- 
manities students. 

Another value generated by the cita- 
tion data is the impact factor of a journal. 
The impact factor "measures the number 
of times the articles in a journal have been 
cited in a given time period, divided by the 
number of articles in that journal" 
(Schmidt, Davis, and Jahr 1994, 47). Be- 
cause it is based on a large body of litera- 
ture cited by authors from many different 
countries, the impact factor assigned to a 
particular publication reflects interna- 
tional rather than local impact. One com- 
parison of impact factors with local use 
data found that the correlation between 
them was weak (Schmidt, Davis, and Jahr 
1994). 

Interlibrary Loan and Other 
Form-rased Methods 

Several authors, such as Evans (1990), 
have examined interlibrary loan statistics. 
These data can provide valuable informa- 
tion regarding the use of material that is 
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not owned locally (Ambia 1991; Chrzast- 
owski 1991) as well as identify which local 
holdings are lent to others outside the 
institution (Chrzastowski 1991; Fjallbrant 
1984). Gossen and Irving (1995) com- 
pared data from a use study of bound and 
unbound journals with data from an 
ARL/RLG interlibrary loan cost-effec- 
tiveness survey. 

Interlibrary loan guidelines stipulate 
that an institution may receive only five 
copies of articles from the five most recent 
years of a journal within any one year 
period. Any requests above this amount 
are considered outside the fair use provi- 
sions and are subject to copyright royalty 
payments (Gossen and Irving 1995; Nay- 
lor 1990). 

Because of copyright law require- 
ments, interlibrary loan departments 
keep records of items requested from 
other institutions, particularly regarding 
journal articles. Therefore, these records 
are an excellent source of information re- 
garding what is being borrowed from 
other institutions. It is best, however, not 
sly on only one year's data, because the 
copy limit is low enough that one 
patron could easily skew the results. How- 
ever, if titles appear on the list year after 
year, then the ride should become a can- 
didate for addition to the collection. 

The same logic holds true for external 
document delivery data, although many 
services allow patrons to order directly from 
them. Because, in these cases, the library is 
not being used as an intermediary, the li- 
brary will have only a partial picture of the 
information being requested through this 
medium. Christiansen, Davis, and Reed- 
Scott discussed advantages and disadvan- 
tages of an internal document delivery 
study, which "simulates users walking into 
the library and each user looking for a par- 
ticular item" (1983, 436). 

Other form-based data sets are poten- 
tial sources of use information. Photo- 
copier use logs are one such method 
(Johnson and Trueswell 1978; Veenstra 
and Wright 1988). Others are requests for 
photocopies made by library staff (Ambia 
1991) and requests for material housed at 
remote locations. The latter data source is 
currently being studied at Penn State. 



A Library Scenario 

The method or methods employed in any 
given library at any given time should de- 
pend on the needs of the library and the 
resources available for the study. As has 
been stated earlier, each different meas- 
ure has its strengths and weaknesses, and 
they can gauge different aspects of collec- 
tion use. Furthermore, although they can 
measure past or current use, they cannot 
measure future use, so use data should be 
collected on a regular basis. 

Ideally, different methods should be 
used in tandem. Consider the scenario of 
a librarian in an academic setting who is 
responsible for a collection with extensive 
journal holdings . Because of the history of 
serials pricing during the past decade, this 
librarian might anticipate the possibility 
of having to conduct serials cancellation 
projects on an annual basis. What might 
the librarian do? 

In this example, the librarian might 
choose to search the SCISEARCH data- 
base for local citation data. If journal hold- 
ings circulate and the local online catalog 
has the proper report generating capabili- 
ties, circulation data could be obtained. 
The librarian might also choose to poll the 
faculty using the collection as well as the 
library staff, particularly the staff who are 
close to the reshelving operations. Inter- 
library ban data, both borrowing and 
lending, and other document delivery 
data could also be obtained. All of this 
information is usually available at a rela- 
tively modest cost, and can be collected in 
a reasonably short time frame. 

Although the results are weighted in 
favor of faculty and graduate research in- 
terests instead of undergraduate and cas- 
ual use, the inclusion of input from the 
library reshelving staff should moderate 
this bias somewhat. However, the librar- 
ian might also choose to superimpose on 
this annual process other use measures, 
which could be conducted on a less fre- 
quent basis. 

For instance, a reshelving study using 
the sweep method might be conducted. 
Because this method does not consider 
who was using the collection but only what 
was being used, some of the imbalance 
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between user populations could be elimi- 
nated. However, it still does not address 
the users who reshelve their own material. 
For this the librarian may decide to con- 
duct a study of non-use of selected titles 
to verify the reshelving data. This might 
also be useful in the case of titles that are 
producing contradictory results in the dif- 
ferent use studies. The librarian might 
also opt to study the people browsing the 
journal stacks. Although not as useful for 
particular titles, this method can provide 
a measure of the level of undercounting in 
other methods. 



Conclusions 

Use studies can be conducted in a wide 
variety of ways, and they can measure 
different aspects of the use of a collection. 
Each method has its own particular 
strengths and weaknesses. Unfortunately, 
results obtained from use studies are 
sometimes ignored, or if considered, 
weighted so lightly as to be unimportant 
(Millson-Martula 1988). However, many 
years of static or declining budgets com- 
bined with increasing prices for both seri- 
als and monographs require librarians to 
use every means possible to justify budg- 
ets. At the same time, costs of storing 
collections are also rising. Libraries can no 
longer afford to own everything, and low 
use materials, however they are defined, 
need to be identified. 

This means that use studies become 
very important sources of justification 
data. If a combination of methods are 
used, their weaknesses can offset each 
other, and a truer picture of overall use 
might be obtained. A particular set of data 
can become obsolete, however, because 
the interests of the users are dynamic 
rather than static. Therefore, it is impor- 
tant to integrate use studies into the nor- 
mal work flow of a library. By doing this, 
the data will be available when needed, 
and the librarian can confidently make 
appropriate collection decisions. 
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The Citation Maze: 
A Beginner's Guide 

Barbara Frame 

The variety of ways in which citations can be used in libraries is broad, 
sometimes confusing, and often poorly understood. Citation studies can, 
however, be classified into four general types: (1) Bibliometric studies con- 
ducted to determine which journals in a given field are the most important 
to scholars in that field, (2) Citation counting in order to assess an author's 
eminence, scholarly or otherwise, (3) Studies designed to describe or map 
the literature of a particular subject, and (4) The use of citations as a direct 
means of collection evaluation. 



^^^hen librarians talk among them- 
selves about citation analysis, the conver- 
sation is likely to drift into conFusion and 
incomprehension. This is, at least in part, 
because citation analysis assumes a wide, 
often bewildering, variety of forms, and is 
used for a broad range of purposes. 

Citation analysis is distinguished by its 
extreme variability and flexibility: "There 
is no standard procedure for using citation 
analysis, and no standard protocol for in- 
terpreting the results" (Smith 1988, 220). 
Rather, since each study is carried out for 
a specific and often unique purpose, the 
basic methodology is subject to constant 
re-adaptation, depending on the project 
at hand. 

Four Types of Citation Study 

Nevertheless, it is possible to divide cita- 
tion studies into four general types. They 
are: 

1. Bibliometric studies conductedto deter- 
mine which journals in a given field are 



the most important to scholars in that 

field (Faigel 1985; Hall 1985). 

This form of citation analysis may be 
useful in establishing which journals are 
the most reputable in their fields, and may 
therefore assist in collection develop- 
ment. Citation-counting exercises are car- 
ried out in order to produce ranked lists 
which can be useful in extending, reduc- 
ing, or otherwise rationalizing a library's 
periodical subscription (Broadus 1985; 
Fitzgibbons 1980; Pan 1978; Swigger and 
Wilkes 1991; Voos 1981; Wiberley 1982). 

The underlying principle is known as 
Bradford's law of scattering, which "pos- 
tulates that a small core of journals will 
publish the great majority of articles in a 
discipline and the remainder will be scat- 
tered in a large number of journals" (Hall 
1985, 55). Traditionally, "Monographs 
have received less attention than serials 
because of the low frequencies of citations 
in the sciences where most of the the 
studies were conducted" (Fitzgibbons 
1980, 294). 

Bibliometric studies have not met with 
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universal approval. Dissenters include 
Line (1978, 313), who argues that "no 
measure of journal use other than one 
derived from a local-use study is of signifi- 
cant practical value to libraries," and 
Scales (1976) who believes that, because 
of discrepancies between citation rank- 
ings and frequency of actual use, the 
method cannot be considered reliable. 
Smith (1988) argues that the method is 
intrinsically flawed, and too subject to er- 
ror to be useful. 

2. Citation counting in order to assess an 
author's eminence, scholarly or other- 
wise. 

As institutions of higher learning strive 
to improve academic accountability, to 
balance budgets, and to allocate funds in 
often fiercely competitive environments, 
analyzing citations of publications by staff 
members is increasingly seen as a way to 
measure the value of staff research and 
hence of assessing the relative merit of 
individuals within the institution. Ban 
Seng and Willett (1995) report on a cita- 
tion analysis project comparing citations 
per academic staff member with ratings 
received in an official research assessment 
exercise. They also found that citation- 
conscious researchers are likely to attract 
more citations in certain kinds of publica- 
tions. 

Assessments of the validity of this ac- 
tivity vary considerably. Garfield (1970) 
has suggested that citations can reliably be 
used in allocating "prizes, grants, fellow- 
ships and other forms of recognition," and 
even in predicting Nobel prize winners. 
Elsewhere, however, (1963) he acknow- 
ledges that overestimating their signifi- 
cance can lead to the undeserved promi- 
nence of individuals such as the 
discredited Russian biologist Lysenko. 
Comfort (1970) points out that reliance on 
citation counts could elevate the late 
Chairman Mao to the position of top sci- 
entist, while consigning Jesus Christ to 
obscurity. 

Similarly, others discount the value of 
citation counting as a measure of the merit 
of institutions or groups of researchers 
(Carey, Solomon, and Wilson 1995). The 
method is suspect because original arti- 



cles may be eclipsed by new articles, be- 
cause even articles by eminent scholars 
may contain errors, because unimportant 
articles in currently fashionable research 
areas may be heavily cited, and because 
groundbreaking articles may not receive 
attention for several years. Kelland and 
Young (1994) point out that not all cita- 
tions are of equal value, because of their 
wide variety of functions: citation may be 
done for purposes of criticism or refuta- 
tion, and perfunctory or misleading cita- 
tion, or excessive self-citation, may distort 
findings. 

3. Citation studies whose purpose is to 
describe the literature of a particular 
subject, usually to provide insights into 
the nature of scholarly communication. 
In such studies, variables such as for- 
mat, age, language, and subject spread 
may be analyzed. Examples include: 
Attwood's (1991) study of citations in New 
Zealand Libraries, conducted in order to 
examine influences on New Zealand li- 
brary researchers who publish; Heinzkill s 
(1980) examination of the characteristics 
of references in journals devoted to Eng- 
lish literature; and Popovich's (1978) de- 
scription of a business management col- 
lection. 

Nisonger (1983) enhanced the useful- 
ness of this kind of study by further ana- 
lyzing his samples in terms of language, 
format, date, and subject area. Although 
this technique has implications for collec- 
tion development, it is less likely to be 
useful in evaluating or comparing library 
collections. 

4. The use of citations as a direct means of 
collection evaluation. 

Citations are gathered, and checked 
against library holdings to determine the 
extent to which "the work could have been 
written with the resources available at that 
library" (Hall 1985, 56). Studies of this 
kind, sometimes referred to as citation- 
reference studies (Mosher 1984) fall into 
two main sub-groups: 
1. Citations are gathered from works 
produced outside the institution con- 
ducting the study. Bland (1980) sug- 
gests compiling lists from the cita- 
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tions of standard college textbooks. 
The method was tested by Stelk and 
Lancaster (1990, 193), who found 
that "sources cited in texts required 
in undergraduate courses can indeed 
be a useful component in the valu- 
ation of the holdings of an under- 
graduate library." Gallagher (1981, 
37) used the citations in a classic oph- 
thalmology textbook to determine 
the extent to which it "could have 
been written using the library's col- 
lection as the primary literature 
source," and expressed satisfaction 
with the validity of the results. Nison- 
ger (1983) tested two specific tech- 
niques — which differed in the ways 
the citations were selected from 
source journals — in evaluating a po- 
litical science collection, and con- 
cluded (p. 174) that both techniques 
employed "reliable and valid evalu- 
ation methods." Since postgraduate 
materials were involved, he doubted 
the effectiveness of this particular ap- 
proach "for evaluating a collection's 
ability to support teaching at the un- 
dergraduate level." 

In a further development of this 
method, Lopez (1983), using titles 
from Choice as a starting point, devel- 
oped a five-level process in which 
cited items were themselves used as 
sources of citations, and a complex 
scoring system was employed. This 
refinement fosters the inclusion of 
older and newer library materials, and 
to some extent replicates the experi- 
ence of actual researchers. 

This method amounts to a sophisti- 
cated version of the time-honored 
list-checking method of library evalu- 
ation. In this case the citation gather- 
ing becomes an alternative method 
for constructing the list (Bonn 1974; 
Gleason and Deffenbaugh 1994; Hall 
1985). Unlike evaluation from stand- 
ard lists, however, it is "based on the 
principle that the actual use of the 
material is indicative of its relevance 
to current research." (Nisonger 1983, 
164). Another likely important differ- 
ence between this refined method 
and a method using standard lists is 



that materials from subject fields 
other than the one under direct inves- 
tigation have a greater chance of be- 
ing represented. Where cross-disci- 
plinary holdings are considered 
relevant, this may prove an effective 
means of list compilation (Nisonger 
1983). Gleason and Deffenbaugh 
(1994) found that only 52.2% of the 
titles they investigated were classified 
at the relevant Library of Congress 
classifications. 
2. In a further refinement of this 
method, the citations are taken from 
published or unpublished works pro- 
duced within the institution, thereby 
providing a more accurate reflection 
of the library's ability to meet local 
need. 

As Line (1978, 313) points out, 
"What is core to one library is mar- 
ginal to another." Buzzard and New 
(1983) took their citations from local 
dissertations. As source material, Le- 
wis (1988) used books, chapters in 
books, papers in conference proceed- 
ings, and journal articles written by 
academic staff at his university, as well 
as Ph.D. theses produced there. 
Dykeman (1994) investigated the 
ability of the Georgia Institute of 
Technology to meet the information 
needs of its scientists by extracting 
faculty citations from the INSPEC da- 
tabase. 

A particular advantage of this 
method is that it is both collection 
centered and client centered, since 
local needs are accounted for as fully 
as possible. Also, locally published 
items are represented; this is impor- 
tant in smaller countries such as New 
Zealand where libraries must offer the 
best international materials but also 
must not neglect the publications of 
their own country. The method also 
enables monograph and periodical ti- 
des to be surveyed in the proportions 
in which they are actually used. 

The methods main disadvantage is 
that its results may be skewed by the 
understandable human preference 
for the locally available item over the 
possibly more desirable but less ac- 
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cessible one: Buzzard and New (1983, 
470) noted the possibility "that there 
may have been a tendency to cite 
works that were accessible and to omit 
those that were not." It seems likely 
that this factor influenced, to some 
extent, Okomo's (1991) finding that 
73% of journal citations from publish- 
ed work generated by science re- 
searchers at the University of Benin 
were available at the University of Be- 
nin Library. 



Conclusion 

Citation analysis is a valuable and adapt- 
able tool which can be used, either alone 
or in conjunction with other tools, to pro- 
duce answers to a wide variety of library 
questions. Citations can provide a meas- 
uring-stick for elements otherwise very 
difficult to measure or describe. Citation 
analysis does not consist of a single 
method or formula, and whenever it is 
applied care must be exercised both in 
understanding the nature of the problem 
at hand, and in devising methods specifi- 
cally tailored to its solution. 
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Editorial 



Richard R Smiraglia 

I-iiforan/ Resources & Technical Serv- 
ices is one of the leading journals in library 
and information science. It has been my 
privilege to serve as editor and chair of the 
editorial board for the past six years — 
since volume 34, number 3. During that 
time I have refrained from writing edito- 
rials, partly because I wanted the journal 
to speak for itself through its content, and 
partly because there was plenty of other 
work to do. But this is my last issue as 
editor, and there are a few things I'd like 
to say before leaving. 

The Association for Library Collec- 
tions & Technical Services (ALCTS), the 
publisher of LRTS, is a very hierarchical 
organization. Consisting of five sections 
that reflect the areas of interest of ALCTS 
members — Acquisitions, Cataloging & 
Classification, Collection Management & 
Development, Preservation and Re- 
prography, and Serials — the organization 
tends to operate according to and within 
this hierarchy. Thus it is sometimes diffi- 
cult to view the content of LRTS as a 
unified or integrated whole — as the con- 
tent of research in collections, for in- 
stance — and there is a tendency to view its 
parts as somehow in competition with one 
another. 

During my editorship (according to my 
records, which are not completely reli- 
able), 293 manuscripts were received in 
my office, of which 191 saw print in LRTS. 
One hundred two manuscripts were not 
accepted for publication, yielding an over- 
all rejection rate of 35%. Articles dealing 
with cataloging & classification accounted 
for roughly 58% of the papers published; 
the rest of the articles were scattered 
more or less evenly across the other seg- 
ments of the organization's interests. The 
relative proportions of subject matter 



among the papers published follow the 
same distribution as that of the papers 
submitted. That is, areas in which a great 
many papers are submitted see more 
achieve print and vice versa, areas in 
which few papers are submitted see fewer 
reach print. Submissions vary from 5% 
(acquisitions) to 63% (cataloging & classi- 
fication). Rejection rates vary widely 
across these subdisciplines, ranging from 
13% for acquisitions (the lowest) to 40% 
for cataloging & classification (the highest). 

In the January 1994 issue (volume 38, 
number 1), Gregory Leazer and I publish- 
ed a bibliometric analysis of the entire 
content of LRTS' first 35 volumes. In that 
article we reported the percentages of ar- 
ticles published per section of ALCTS for 
volumes 1-35. Those percentages have 
not changed — the relative proportions of 
articles across the sections have remained 
stable since LRTS was founded in 1957. 

Early in my term of office, the ALCTS 
Board adopted an official editorial policy 
for LRTS, emphasizing the scholarly ob- 
jectives of the journal (Editorial Policy 
1996, 104): 

The purpose of LRTS is to support the 
theoretical, intellectual, practical, and 
scholarly aspects of the profession ... by 
publishing articles (subject to double- 
blind peer review) and book reviews .... 

Every manuscript received is reviewed 
by at least two referees, who offer advice 
on many aspects of the presentation. 
Their job is very important, for it is they 

cidirsg for the profession which research 
results may legitimately be promulgated 
in the pages of the journal. In the end, 
very few papers are actually rejected out- 
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right; rather, the majority are rewritten 
according to the advice of the referees. 
This gatekeeping function is very impor- 
tant, because the published research that 
has been given LRTS' stamp of approval 
in rum forms the basis for future research 
and therefore determines the advance- 
ment of the discipline. As our discipline 
moves into the murky business of elec- 
tronic dissemination, we must tread care- 
fully lest we too easily renege on our 
gatekeeping responsibilities. 

Leazer and I hoped with our 1994 ar- 
ticle to demonstrate that LRTS had the 
characteristics of a scholarly journal, serv- 
ing a research-based technological profes- 
sion. We concluded (Smiraglia and Leazer 
1994, 45): 

In sum, LRTS by and large reflects the 
growth of a maturing, scholarly discipline 
surrounding the orientation paradigms 
that ALCTS exists to serve. 



I am pleased to reiterate this conclu- 
sion as my term draws to a close. LRTS 
reflects the continued maturation of the 
subdisciplines surrounding collections 
and technical services, which are them- 
selves healthy, vital, research-based parts 
of our field. As I leave LRTS in the capable 
hands of Jennifer Younger, I am proud to 
have been a part of the development of 
our profession. 
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Eva Verona, 1905-1996: 
An Appreciation 



Michael Carpenter 

E va Verona (Trieste, February 1, 1905- 
Zagreb, May 19, 1996) was a Croatian 
librarian who, when she entered the inter- 
national arena for the revision of cataloging 
rules, made many enduring contributions 
to the way we do things today. 

Eva Verona's education was in physics 
and mathematics in the Faculty of Phi- 
losophy of the university in Zagreb. While 
a university student, she worked as a li- 
brarian in the Department of Surveying, 
developing a union catalog for Zagreb li- 
braries of publications in physics and 
mathematics. This project later evolved 
into her first book, a 1941 list of library 
resources in Zagreb (Verona and MiSic- 
Jambrisatc 1941). After graduating from 
the university in 1929, she started work in 
what was later to become the Croatian 
National and University Library. By the 
early 1950s, she had become the head of 
two departments in that library — those 
for printed library materials and technical 
services — continuing until her retirement 
in 1967. Starting in 1966, she became a 
senior lecturer at the University of Zagreb 
and continued in this position well into the 
1980s. 

At the time of Verona's work, Croatia 
was a constituent unit of a federal state, 
Yugoslavia, Her work was not confined to 
the narrowness of a single constituent re- 
public, lor Verona became the founding 
chair of the Yugoslav Committee on Cata- 
loging, which was established by the Un- 
ion of Library Associations of Yugoslavia 
in 1961. 

Verona made several scholarly contri- 
butions to English-language library litera- 
ture, including articles on form headings 



(Verona 1962), the early history of corpo- 
rate entry (Verona 1956), and the distinc- 
tion between literary units and biblio- 
graphical units (Verona 1959). The library 
resources she used in the composition of 
these articles are in a host of languages 
and must have come from a truly cosmo- 
politan collection of library literature. To- 
day these studies are still marvels of clarity 
of exposition and contain excellent cover- 
age of the relevant materials. 

In these and other contributions, there 
are many references to Croatian catalog- 
ing practice, references that were to be 
systematized in her Croatian-language 
publications, in which Verona wrote what 
must be the most important core of that 
languages library literature. She wrote 
the two-volume Croatian cataloging code, 
one volume of which has appeared in two 
editions (Verona 1970-1983 and 1986), as 
well as a more scholarly treatment on the 
alphabetical catalog (Verona 1966 and 
1971). The Croatian cataloging code was 
adopted by the library community in Yu- 
goslavia as a whole. For many years, she 
was the chief editor of the journal Vjesnik 
bibliotekara Hrvatske [Bulletin of Croa- 
tian Librarians] (1950- ) as well as a driv- 
ing force in the Croatian library associa- 
tion, the DruStvo bibliotekara Hrvatske. 

According to Phyllis Richmond (1993), 
Verona first attended meetings of IFLA 
(International Federation of Library As- 
sociations) in 1952 and continued to do so 
for the next twenty-five years. Verona's 
work had its major effect on cataloging 
practice through her committee work in 
IFLA and work with IFLA-sponsored 
conferences. 
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As chair of the Yugoslav Cataloging 
Committee, Verona was a delegate to the 
International Conference on Cataloguing 
Principles (the "Paris" conference) of 
1961 as well as a contributor of a working 
paper for the conference. In this working 
paper, Verona set forth a cardinal point of 
Croatian cataloging practice, the use of 
added entry or reference cards for uni- 
form tides rather than inserting them in 
the main entry. 

The Croatian cataloging rules work in 
a card catalog environment, but unlike 
those that used to be prevalent in the 
United States, the card catalog envisioned 
in these rules does not rely as consistendy 
on unit card technology. Occasionally 
added entries are abbreviated, often tak- 
ing the form of references to the main 
entry. 

In todays online environment, the 
controversy over whether uniform titles 
should be part of the main entry or an 
added entry might appear pointless, per- 
tinent only to the card catalog environ- 
ment. Such a conclusion would be mis- 
taken: Imagine finding a uniform title for 
a translated work arranged under the 
heading for a translator or an illustrator. 
The uniform title in that context makes 
one think of the translator or illustrator as 
author of the work when that is manifestly 
not the case. Such situations can easily be 
found in some online catalog displays. 

The position enunciated by Verona in 
her Paris conference paper is similar to 
that found in her "Literary versus Biblio- 
graphical Unit" cited above. In the Paris 
conference, she was opposed by Seymour 
Lubetzky, who thought it best to make 
uniform titles part of the main entry, a 
position that has been adopted by most 
cataloging agencies today. 

What is probably Verona's most impor- 
tant achievement in international catalog- 
ing unification came about as the struggle 
over corporate entry played itself out 
among various cataloging agencies. Her 
contributions are found in two books, the 
first a commentary on the Paris Principles 
and the second a full-length study, Corpo- 
rate Headings. 

During the Paris conference, several 
delegations found themselves unable to 



accept the idea of corporate authorship. 
In an attempt to gloss over differences, 
the delegates established a subcommittee 
to redraft section 9 of the draft Statement 
of Principles, which dealt with corporate 
entry. The committee succeeded in its 
task by composing a new section with am- 
biguous wording, a situation that has re- 
sulted in the existence of two tendencies 
in post-Paris codes, one accepting the idea 
of corporate authorship and the other ac- 
cepting corporate main entry only in cer- 
tain limited circumstances. An example of 
each of these tendencies can be found by 
contrasting the 1967 version of the Anglo- 
American Cataloging Rules and its accep- 
tance of corporate authorship and the 
1978 and 1988 versions of the same code, 
the Anglo-American Cataloguing Rules 
second edition (AACR2), with their denial 
of authorial status to corporate bodies. 

With the possibility in mind of differ- 
ing interpretations of the Statement Of 
Principles, which was supposed to unify 
international cataloging, the Paris confer- 
ence decided that an annotated statement 
of principles should be issued. Although a 
preliminary edition was issued by A. H. 
Chaplin, it was deemed insufficient to 
deal with the needs of the profession. At 
the successor to the Paris conference, the 
International Meeting of Cataloguing Ex- 
perts held in Copenhagen in 1969, it was 
decided to appoint a committee to pro- 
vide a definitive annotated statement. 
Verona became the principal author of the 
new and final edition (Verona 1971). In 
addition to a historical commentary on the 
Paris principles, she also provided discus- 
sion and examples of how the principles 
are used in the various post-Paris codes. 
The most important chapter of the com- 
mentary relates to section 9 of the princi- 
ples, that section dealing with corporate 
entry and in greatest need of reinterpre- 
tation. Here Verona documented the 
need for a new interpretation of section 9, 
but ended up by concluding that rewriting 
might prove to be hopeless. 

After the unsatisfactory attempt at re- 
interpretation of the Paris provisions for 
corporate entry in the commentary, 
Verona attended the 1972 Budapest IFLA 
conference and, after lengthy discussions 
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with various delegations to the confer- 
ence, agreed to undertake a new study of 
corporate headings (Anderson 1976), a 
study that would be published in 1975 as 
Corporate Headings. Verona elected to 
arrive at definitions of corporate bodies, 
corporate authorship, and corporate en- 
tries that followed a sort of common de- 
nominator approach, the common de- 
nominator being what all sides to the hody 
disputed topic could agree upon. This ap- 
proach, while not theoretically justifiable 
in and of itself, did bring a measure of 
international agreement on the subject. 

On May 21, 1978, the Parliament of 
the Croatian Republic awarded Verona a 
Republic Medal for Life's Work. The cita- 
tion mentions not only Verona's work on 
alphabetical cataloging theory, but also 
her work in the recovery of Croatian li- 
brary materials that had been captured by 
other nations during World War II, work 
for which she had been previously hon- 
ored with a Medal of Work with golden 
leaves by the republic's president. Addi- 
tionally, she was honored for her work on 
both the current and retrospective Croa- 
tian national bibliographies (Gomercic 
1977-78). 

Verona had to work in a multicultural 
environment within her home country, 
Yugoslavia, a country beset by differences 
in scripts for one common language (Ser- 
bian and Croatian are distinguished by the 
scripts in which they are written, Serbian 
being written in the Cyrillic and Croatian 
in the roman alphabet) and language dif- 
ferences among various parts of the coun- 
try. When she began working in the inter- 
national arena, she seemed admirably 
suited to bridging what appeared to be 
unbridgeable gaps in viewpoints, and her 
work is one of the reasons we can so easily 
speak about, and work with, international 
standards in cataloging today. This is no 
small achievement. I regret that I never 
met her but could only correspond with 
her. 

It is perhaps worthwhile to remark that 
OCLC records no holdings in its member 
libraries for either the latest edition of 
Verona's Croatian cataloging code, or for 
her systematic treatise in Croatian on the 
subject. Verona's work in a multicultural 



environment, her multilingualism (in- 
cluding her limpid style in English), and 
the substantial nature of her contributions 
to our field should focus a grim light on 
our country's current lack of interest in 
international and comparative studies. 

According to Mima Wilier (1996), a 
definitive bibliography of Verona's work 
should appear soon; an earlier version was 
published in 1986 (Horvat and Blazvic' 
1986). Other information on Eva Verona's 
activities up through 1967 is available in 
an anonymous article on her life and work 
published in 1968 ("Eva Verona" 1968). 
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Book Reviews 



Gregory H. Leazer, Editor 

From A to Z39.50: A Networking 
Primer. By James J. Michael and Mark 
Hinnebusch. Westport, Conn.: Meck- 
lermedia, 1995. 166p. Paper. $35 
(ISBN 0-88736-766-6). 
The Z39.50 standard, as library profes- 
sionals should all know by now, is a net- 
work protocol developed by the library 
community primarily for information re- 
trieval among dissimilar, Machine-Read- 
able Cataloging (MARC)-based biblio- 
graphic systems. It was adopted as an 
official standard of the National Informa- 
tion Standards Organization (NISO) and 
the American National Standards Insti- 
tute (ANSI), NISO's parent body, in 1988; 
the most recent edition, known as Version 
3, was issued in 1995. 

In a very real sense and at long last, 
Z39.50 extends to the end-user many of 
the benefits in standardization and coop- 
eration envisioned when the MARC for- 
mats were first developed. In its ideal 
implementation, Z39.50 will allow a li- 
brary catalog user, using his or her own 
local system, to search a number of re- 
mote library catalogs in quick succession 
using the local system's commands and to 
see results conveyed in the local system's 
familiar, native display format. Virtually all 
major vendors of library automation, and 
a good number of providers of indexing 
and abstracting information, now offer ac- 
cess via Z39.50; the list of universities and 
other institutions that have implemented 
Z39.50 servers for their own library cata- 
logs exceeds one hundred and grows daily. 

Apart from the development of the 
MARC standard itself by the Library of 
Congress in the late 1960s, Z39.50 must 
be considered the signal contribution of 
libraries to information retrieval in this 
century, even though — after more than 



ten years of development — its promise is 
only now being realized. Unfortunately, 
for the most part, today's new global infor- 
mation market is characterized by dizzy- 
ingly fast technological obsolescence, and 
hard-won technology standards can easily 
be overwhelmed by popular and innova- 
tive proprietary approaches. Now that we 
finally have the promise of Z39.50 within 
our grasp, we might shortly have to face 
the urgent question of whether the new 
"wired" era will shortly relegate Z39.50 to 
the dustbin of good — but outmoded — 
ideas , or whether this visionary standard will 
survive to become one of the building 
blocks of libraries' quadrant of cyberspace. 

While From. A to 739.50 does not seri- 
ously attempt to address this new set of 
problems, it does serve as a useful sum- 
mary of the origins of the standard and 
includes adetailed conceptual overview of 
the protocol as it was seen in late 1994 by 
two of the contributors to the standard, 
James J. Michael, vice-president of Data 
Research Associates, and Mark Hinne- 
busch, network administrator for the 
Florida Center for Library Automation. 

The work is divided into twelve essays. 
The first six, by Michael, address the his- 
tory and purpose of the standard, and the 
remainder, by Hinnebusch, discuss tech- 
nical aspects of Z39.50 and related proto- 
cols. While both sections of the book con- 
vey a great deal of important information, 
there are, unfortunately, virtually no 
points of connection between the two. 
This is so much the case that one suspects 
a long distance collaboration or perhaps 
even two different books masquerading as 
one. A more cohesive work might have 
been better able to show the ways in which 
the protocol itself reflects both the pecu- 
liar requirements of the library commu- 
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nity and the particular standards develop- 
ment process that was brought to bear. 
Michael's sections, moreover, show a 
repetitiveness and first person folks iness 
that suggest the essays might have been 
cobbled together from past speeches and 
presentations, though this is nowhere 
mentioned in the publication. In style his 
essays too often rely on sweeping asser- 
tions and exhortations rather than care- 
fully-reasoned arguments. For example: 
"Personally, I believe strongly in technical 
standards, (i.e., standards that are arrived at 
by consensus and that are formalized)" (p. 
28) and "If anyone is not willing to acknow- 
ledge [library] interdependence then forget 
about [Z39.50 information retrieval], ILL, 
and document delivery. To talk only about 
cooperative collection development and re- 
source sharing is . . . hypocrisy" (p. 42). How- 
ever much one might agree with Michael, 
the reader would be better served by less 
posturing, fewer aphorisms, and a more 
careful editorial hand. 

Still, Michael is persuasive in many of 
his chief arguments, among them the ob- 
solescence of the ALA/NISO standards 
process that has held sway for the last 
fifteen or twenty years. He makes an elo- 
quent plea for a process of modeling and 
prototyping standards rather than simply 
inventing them in committee. Further, he 
reflects the same frustration with NISO's 
dated paper- and fee-based approach to 
standards publication that many in the 
field have felt: "It seems ludicrous that we 
spend time developing standards to prom- 
ulgate as widely and as quickly as possible 
and then insist on delaying promulgation 
by publishing in print format and charging 
for that print format. Months and dollars 
could be saved by making these standards 
available over networks'* (p. 27). Of 
course, Michael's point would have been 
somewhat more persuasive if it had ap- 
peared in an essay published for free over 
the Internet rather than in a thin, $35 
paperback book. Perhaps, however, Mi- 
chael's views have already had some bene- 
ficial effect, because Z39.50-1995 is now 
available for free electronically in several 
formats from the Library of Congress at: 
http://lcweb.loc.gov/z3950/agency/ 
1995doce.html. Nevertheless, NISO has 



not changed its overall policy in this re- 
gard. 

Michael s portion of the book does pro- 
vide an excellent example of how the proc- 
ess of creating library standards has ma- 
tured during the last ten years and how 
representatives for library automation 
vendors, non-profit bibliographic utilities, 
and research libraries have learned to col- 
laborate on technical standards develop- 
ment. Working together they have created 
prototypes and testbeds to serve both 
groups' interests. This is a process that 
other NISO and ALA standards groups of 
all kinds would do well to emulate. 

This publication has the distinction of 
being probably the only book length treat- 
ment of Z39.50 (though LC's lack of an 
established subject heading for the stand- 
ard makes this difficult to determine with 
absolute confidence). Most of the existing 
literature on Z39.50 has so far been found 
in journals, technical documents, listservs, 
and World Wide Web sites, and those 
wanting more comprehensive and up to 
date information will have to seek it there. 
The ideal audience for this book would 
appear to be working library professionals 
wanting to catch up in this important area 
of technology and willing to mull over a 
fair number of network protocol architec- 
tural and process drawings along the way. 
The book would seem to be ideal, as well, 
for a library school survey course on net- 
working thanks to shorter sections de- 
scribing related networking standards, in- 
cluding Transmission Control Protocol/ 
Internet Protocol (TCP/IP) and Open 
Systems Interconnection (OSI). Serious li- 
brary automation professionals, and thase 
aspiring to such work, will find this a useful 
point of departure and a provocative discus- 
sion of library standards -making. 

Because From A to 739.50 mysteri- 
ously includes neither a bibliography nor 
a "webography," it is useful to cite here the 
two major online information sources cur- 
rently available: the Library of Congress* 
Z39.50 maintenance agency site (http:// 
lcweb.loc.gov/z3950/agency/); and the In- 
terNIC Z39.50 resources page (http* 
ds.intemic.net/z3950/z3950.html). The LC 
site has grown to be quite comprehensive, 
with its own bibliography, links to online 
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versions of papers on Z39.50, minutes of 
the Z39.50 Implemented Group (ZIG), 
and many other resources. 

It might be a service to the library 
community to see either the authors or 
others working with the standard follow 
up this book with a series of essays, pref- 
erably made available online, that present 
in a relatively non-technica! way some of 
the issues and design considerations that 
have arisen during more recent work. 
Some subjects worthy of discussion in- 
clude the digital collections profile, the 
Computerized Interchange of Museum 
Information (CIMI) profile, ranked list 
query, the Inter-Library Loan (ILL) pro- 
tocol, and structured vocabulary browse 
proposal. Beyond these, of course, lie the 
larger questions: in a world of creative, 
new, non-library-based indexing and re- 
trieval services such as Alta Vista, Excite, 
Lycos, and the many others to come — 
services with huge composite megain- 
dexes that will in due course include a 
great deal of bibliographic information — 
will there still be a need for Z39.50's ap- 
proach to intersystem communication? 
Further, when document ordering, 
browsing, reading, and "microcharging" 
can all take place over the Web, directly at 
the publishers Web site, will there still be 
a role for Z39.50 at all?— Stephen Paul 
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Two monographs on the subject of ex- 
pert systems for reference services were 
published before this book. The first, en- 
titled Expert Systems In Reference Serv- 
ices, was originally published as a special 
issue of Reference Librarian in 1989. It 
contains eleven articles that describe the 
potential of expert systems and document 



several microcomputer-based prototypes 
(Roysdon & White, 1989). Alberico and 
Micco (1990) share a scope similar to that 
in Richardson's book. Both provide a gen- 
eral introduction to artificial intelligence 
and expert systems, and address the mod- 
eling of reference services. Although both 
books include surveys of expert system 
applications in reference services, Al- 
berico and Micco s is more a broad over- 
view, while Richardson treats the subject 
in more depth. 

In the first half of chapter 1, Richard- 
son systematically explores the history of 
reference teaching and the reference 
paradigm. Richardson does so by examin- 
ing the tools for teaching: its textbooks. 
Individual textbooks are considered in 
chronological order, and Richardson de- 
votes a separate section to each one dis- 
cussed; the name of the textbook writer 
serves as the section heading. Each sec- 
tion begins with brief background infor- 
mation about the textbook writer followed 
by an analysis of the book itself. The fact 
that Richardson almost always begins 
each section with a biographical note on 
the textbook writer lends his study a de- 
cidedly historical flavor. In analyzing the 
textbooks, Richardson looks for answers 
to three questions: (a) How are reference 
works arranged (i.e., format)? (b) How is 
reference work described (i.e., method, or 
so called procedural knowledge)? and (c) 
How does the reference librarian interact 
with the user (i.e., mental traits)? By con- 
sidering these questions, Richardson is 
able to explore the three basic facets of a 
paradigm for teaching reference work. 
That paradigm is discussed in detail in the 
second half of the chapter. 

Chapter 2 defines an expert system 
by briefly outlining its major aspects: 
its history, types of knowledge, infer- 
ence engine, system interface, the ma- 
jor AI (artificial intelligence) pro- 
gramming languages, and knowledge 
ehdtation methods. Richardson justi- 
fies the role of expert systems in library 
and information science (LIS) in the 
final section of this chapter, by pointing 
out all groups of people who should have 
vested interests in expert system devel- 
opment. 
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In chapter 3 Richardson argues that 
reference work is a viable domain for rule- 
based expert systems. On one side of the 
rule (i.e., condition) reference questions 
are broken down by category. On the 
other side (i.e., conclusion) answers are 
provided according to formats of refer- 
ence sources. Richardson relies heavily on 
speculation when discussing boundary 
considerations, likelihood of success, and 
the philosophical and ethical issues of ex- 
pert system development. 

A flowchart model of general reference 
transactions is the theme of chapter 4, 
"Modeling the Reference Transaction." 
This model is explained in detail and is heav- 
ily supported by another excellent historical 
study on research in reference transactions. 

Chapter 5 develops a blueprint of an 
expert system for general reference work; 
this is based on the procedural-rule model 
introduced in chapter 3. Richardson takes 
the time to explain not only the basic- level 
rules for various formats of reference 
sources but also the tree structure of sub- 
ordinate-level knowledge for each format 
of reference sources. Although Richard- 
son presented the tripartite paradigm of 
reference work in chapter 1, the blueprint 
presented here primarily utilizes the for- 
mat facet of that paradigm. 

Chapter 6, written by three former 
Richardson students, deals with a periph- 
eral topic of this book: the criteria used to 
evaluate expert system shells. It begins 
with a very brief introduction to expert 
system shells, and proceeds to give a list 
of criteria for selecting an appropriate ex- 
pert system shell. These criteria are 
grouped into the following sections: 
knowledge base, methods of reasoning, 
interface, update and editing, end- user 
interface, software, hardware, training, 
documentation, and cost. This chapter 
builds on the introductory text in chapter 
2 and addresses the application level of 
expert system research. 

The issue of user interface in a refer- 
ence expert system is the topic of chapter 
7, written by Karen Howell. Early in the 
chapter, Howell reviews research on user 
interface and identifies some misconcep- 
tions about user interface design. This is 
followed by specific suggestions on user 



interface design for a general reference 
expert system. 

Chapter 8, complements the discus- 
sion in chapter 6 on the application level 
of expert system research by providing a 
catalog of prototype and commercial ex- 
pert systems in reference services. A total 
of fifty-seven projects are described, with 
each project given a separate section. In- 
formation about each project includes the 
name of the project's principal investiga- 
tor, staff, and domain experts. Richardson 
also provides detailed information about 
the hardware, software, scope, system 
size, user interface, special features, per- 
ceived benefits, and cost. This extensive 
catalog is followed by an essay that evalu- 
ates recent progress. The typical knowl- 
edge-based system in reference service, 
Richardson summarizes, "has been built 
by one or two people using a shell" for an 
academic library environment; "it is a rela- 
tively uninspired system, not based on a 
theoretical model of reference transac- 
tions." He concludes that "it is much eas- 
ier to create a first-generation prototype 
than it is to put an operational KBS 
[knowledge-based system] into place," 
and calls for the research and develop- 
ment of second-generation expert sys- 
tems (p, 294). However, Richardson does 
not clarify in this chapter what might dis- 
tinguish first- and second-generation ex- 
pert systems from one another. 

The final chapter emphasizes the fu- 
ture of expert systems for reference serv- 
ices and its constraints and consequences. 
At the core of this chapter is an attempt to 
describe past constraints, dispel current 
doubts, and provide optimism for the fu- 
ture. An appendix gives achecklist of criteria 
for selection and an annotated listing of 
more than 20 available expert system shells. 

Richardson's monograph is a record of 
several research projects he has con- 
ducted in the past few years that had the 
purpose of further understanding the 
teaching and practice of reference work. 
The numerous awards that chapters of 
this book have received show the 
strengths of this book: comprehensive 
scope; in-depth and well-documented re- 
views; and superb, systematic organiza- 
tion. Many chapters of the book can serve 
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as excellent sources for different groups 
of readers: educators studying reference 
textbooks, researchers modeling refer- 
ence transactions, and students with ad- 
vanced knowledge in the development of 
expert systems in general and application 
of reference services in particular. Re- 
searchers and advanced students who 
study expert systems in other areas, such 
as cataloging and classification, will fmd 
individual chapters valuable for surveying 
the subject area. Readers will be delighted 
to find the extensive reference notes at the 
end of individual chapters and the bibli- 
ography at the end of the book. 

Having said that, however, it is necessary 
to point out several of the book's weak- 
nesses. Richardson's overall arrangement is 
problematic. The division of chapters into 

progress) seems arbitrary, and the explana- 
tion of this tripartite structure in the preface 
(p. xii) is confused and unconvincing. Chap- 
ters 2 and 3 appear to be out of place in 
relationship to the book's other theoretic; J 
discussions on reference work. Richardson's 
own recommended teaching order (p. viii) 
is further evidence that the chapters are not 
arranged in logical order. The arrangement 
of chapters contributes to another problem 
in the book: the lack of a smooth transition 
between chapters. This problem might be 
due partially to the fact that some chapters 
were written as independent research pa- 
pers, although Richardson couid have 
solved it by giving users more help in his 
introduction. Finally, the historical research 
in this book, while contributing to the 
strengdi of chapters 1, 4, and 8, also contrib- 
utes to an imbalance in the depth of per- 
spective on the subject areas treated. The 
comprehensive, well-documented histori- 
cal reviews contrast sharply with the weaker 
generalizations and speculations on the fu- 
ture of expert systems. One wonders 
whether Richardson is as confident in, and 
positive about, the future of expert system 
research as he is about its history. 

Research on expert systems enjoyed al- 
most a decade of popularity among LIS 
researchers since its introduction to our 
f ield by Smith, who wrote her dissertation in 
1979. Like much technology-related work, 
this research began with high hopes and 



enormous potential, and stimulated nu- 
merous experiments and prototypes. Re- 
searchers and advanced students spent 
countless hours reading textbooks on ex- 
pert systems and learning ahout artificial 
intelligence programming languages. The 
common purpose among many designers 
of expert systems in LIS was, in most 
cases, to identify a very narrow domain of 
library operations and to codify what 
many saw as the simple rules and proce- 
dures of those operations into procedural 
knowledge of an expert system. But he- 
cause the researchers studied narrow do- 
main and simple routine library tasks — 
and made no attempt to study the 
formidable issue of knowledge acquisition 
and representation — it proved impossible 
tu transform their prototypes into success- 
ful operational systems. As the majority of 
projects faded or were forgotten near the 
end of 1980s, many researchers con- 
cluded thai expert systems offered more 
limitations than possibilities and thus 
moved on to other topics. One of the few 
traces left from LIS expert system re- 
search is the keen awareness, among some 
researchers, of the need to study the con- 
duct and learning process of LIS profes- 
sional knowledge and skills. Richardson 
provides an important contribution to the 
area of" LIS expert system research by 
analyzing reference teaching and refer- 
ence transactions through historical stud- 
ies and surveys. — Ling Hwey Jeng, School 
of Library and Information Science, Uni- 
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tion Science, no. 85. Westport, Conn.: 
Greenwood, 1995. 176p. $49.95 (ISBN 
031328461X). 

As library schools struggle to reinvent 
themselves for the Information Age, it is 
helpful to speculate as to why some of the 
most prestigious library schools in the coun- 
try have closed in recent years, library 
schools have been caught off guard in a 
suddenly hostile environment. However, 
this work does not go into the reasons why 
specific library schools closed. Instead, the 
authors present ideas for discussion. 

This book begins with an examination 
of the history of library schools and higher 
education in the United States. The 
authors then go on to assess the present 
challenges that library schools face and 
possible strategies for overcoming these 
challenges. Finally, the authors present 
their own ideas for future library school 
programs and curricula. The lengthy sec- 
tion of appendixes (over half the book) 
provides examples of accreditation stand- 
ards, mission statements, and library pro- 
grams in use today- 
Two chapters offer a historical per- 
spective. The first outlines the evolution 
of higher education in the United States. 
Demographic, political, and economic 
factors all played a role in fashioning 
higher education into what it is today, Es- 
pecially relevant is the section on profes- 
sional education (p. 11), which was first 
elevated to higher education at Harvard 
around the turn of the century. 

The next chapter provides a history of 
library education in America. It would 
have been interesting to learn more about 
how library schools became established in 
America but the authors present only a 
brief summary, The authors analyze 
Melvil Dewey's impact, claiming that 
Dewey "led the profession astray" (p. 23) 
by emphasizing practice over theory. The 
authors note the apparent lack of found- 
ing thinkers in library science, although 
they do mention a number of names, in- 
cluding Ralph Shaw and Jesse Shera. They 
return to this lack of a theoretical basis for 
library science in a later chapter. 

In the next five chapters of the book, 
the authors discuss the present and future 
of library education in America. Chapter 



4 discusses the "paradigm shift" that li- 
brary schools have failed to notice. They 
cite Daniel Bell's argument that society is 
experiencing a shift "from an industrial to 
apostindustrial society where information 
has become a prime commodity" (p. 25). 
This shift began in the early 1960s. New 
trends in science and technology, such as 
computer networks, began to alter library 
work but library schools failed to notice 
these new trends. New organizational 
structures also emerged with new atti- 
tudes towards management, and library 
schools failed to recognize these new 
management styles as well. 

Chapter 5 returns to the unanswered 
question that hangs over the faculty of 
every library school: is there a science to 
library science? If so, what is the body of 
scientific knowledge? If you ask one li- 
brarian, you get the answer that cataloging 
is the core of librarianship. If you ask 
another, you get the answer that helping 
the community is the core of librarianship. 
There is no agreement on a general body 
of knowledge. And the body of knowledge 
that does exist continues to fragment as 
schools devise new curricula. 

In the next three chapters, the future 
of library education is considered. In 
Chapter 6, the authors present an argu- 
ment for developing and implementing 
strategic plans in library schools because 
"the failure to plan effectively contributed 
to the decline and closing of some library 
schools" (p. 37). The authors give some 
examples of problems in planning and of- 
fer some solutions. 

In Chapter 7, the processes of certifi- 
cation and accreditation are examined. 
The authors feel that more rigorous certi- 
fication of professionals will strengthen 
the position of library schools. The 
authors believe that quantitative and 
qualitative standards should be estab- 
lished for librarians to receive certifica- 
tion, and for library programs to be ac- 
credited. The authors point to several 
other professions that have instituted ba- 
sic standards. Accountants and teachers 
both have to meet professional standards 
in order to work in the profession or be- 
long to professional organizations. Archi- 
vists have a certification process. The 
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authors mention the American Library 
Association's standards for accreditation 
of library schools but they seem to feel 
that the ALA's standards do not meet the 
demands of the new marketplace that li- 
brary schools face. 

Chapter 8 presents the authors' ideas 
for redesigning library education, point- 
ing to several areas in library education 
that need reform. The authors advocate 
strengthening the professional degrees by 
adding prerequisites for admission into a 
professional program, lengthening the de- 
gree program beyond a year, introducing 
areas of specialization into the curricu- 
lum, creating an undergraduate degree in 
information science, and abandoning ac- 
creditation for a free-market approach. 

The authors present a new curriculum 
where undergraduate instruction would 
teach students basic library skills equiva- 
lent to paraprofessional skills in a library. 
The graduate programs would teach more 
theory, building on the basic skill set 
learned in undergraduate education. 
Doctoral study would involve further re- 
search and study of theory. 

Although there is a rich academic his- 
tory in the field of library and information 
science, it is doubtful that many students 
will want to study it for five or six years. 
Paraprof essional skills require mastering 
repetitive, mundane tasks such as filing or 
data processing. While these skills run a 
library, they are not worth studying at a 
university level, and do not form the basis 
of a liberal education — the foundation 
upon which many professions (including 
librarianship) is formed. 

The authors also fail to take into ac- 
count the low wages in the library field. 
What incentive is there to spend years in 
school preparing for a profession that pays 
below the average salary of other profes- 
sions with comparable responsibilities? A 
professional school is only as good as the 
profession it serves. Among other reasons, 
students are willing to spend three years 
in law school because they know they can 
make a decent salary when they graduate. 
Library school graduates, on the other 
hand, are some of the lowest paid profes- 
sionals in the country. Library schools can- 
not dictate the terms of the profession; 



they must instead respond to the needs of 
the profession. 

When one examines the history of li- 
brary education in America, one sees that 
library schools, as the authors point out, 
have always been pressured by external 
forces. Library schools emerged at the 
turn of the century as the number of li- 
braries in America increased and demand 
for librarians grew. Andrew Carnegie and 
other captains of industry were willing to 
spend money to develop a network of li- 
braries across the country. At the same 
time, professional schools began to affili- 
ate with universities in an effort to im- 
prove quality. From the very beginning, 
library schools were tied to universities — 
with Dewey opening the first library 
school at Columbia University in 1887. 

After World War II, the United States 
government realized that scientific research 
and development was of critical importance 
to national security. Throughout the Cold 
War period, universities received massive 
research and development funding from the 
government. Library schools were affiliated 
with many of these universities. As the uni- 
versities grew wealthy, the library schools 
shared the good fortune. 

Since the Cold War ended, research 
and development have no longer been 
as great a national security issue. Gov- 
ernment funding for research and de- 
velopment has dried up and universities 
that had grown fat from forty years of 
funding suddenly have had to become 
lean and mean. Library schools, never the 
glamorous centerpiece of any institution, 
have fallen victim to the budgetary ax as 
universities trimmed their costs in the 
new environment. Wedded to universi- 
ties, library schools must share the fate of 
higher education. 

There is a great need for information 
skills in the new postindustrial age de- 
scribed by the authors. The Internet 
presents a whole new chaotic world of 
information for catalogers to control and 
reference librarians to explore and ex- 
plain. It is hoped that leaders of the library 
profession and of programs of library and 
information science will recognize this and 
maybe, one day, librarians will earn more. — 
Barrett Jones, BAND Corporation 
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"Selecting Microfilm for Digital Preservation: A 
Case Study from Project Open Book" 67-77 

"Selection for Preservation: A Digital Solution 
for Illustrated Texts" 78-83 

Serials, see also Journals 

acquisition of, in Nigeria: 262-66 
acquisition of, from People's Republic of 

China: 62-65 
tide changes: 43-48 
users' locating of: 49-60 

Simpson, Pamela: 41-48 

Slides: 93-95 (r) 

Smiraglia, Richard P.: 375-76 

Smith, Stephen J.: 99-101 (r) 

Snavely, Loanne: 49-60 

Snow, Maryly: 93-95 (r) 

Sparkman, Kathleen: 193-95 (r) 

Stalker, John C: 319-26 

Stone, Alva X: 197-200 

"The Structure of the Library Market for Sci- 
entific Journals: The Case of Chemistry" 
145-70 

"A Study of Cutter Number Adjustment at 
the Ohio State University Libraries" 319- 
26 

"Subject Access to Fiction: An Application of 

the Guidelines" 203-10 
Subject cataloging: 185-88 (r) 
Subscriptions 

cancellation and reinstatement of: 262-66 
Summer, Susan Cook: 84-92 
Swanson, Edward: 389-92 

T 

Tables of contents 

in bibliographic records: 133-38 
"Tables of Contents in Library Catalogs: 

A Quantitative Examination of Analytic 

Catalogs" 133-38 
Technical services 

management of: 289-92 (r) 
Technical services workstations: 171-83 
"Technical Services Workstations: A Review 

of the State of the Art" 171-83 
"Thesis and Dissertation Citations as Indica- 
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library Journal Collections" 335-42 

Tibbits, Edie: 33-40 

Transaction log analysis: 211-36 

u 

"UCLA/OCLC Core Record Pilot Project: 

Preliminary Report" 251-60 
Universal decimal classification: 99-101 (r) 
University of California at Los Angeles: 251- 

60 

University of Ilorin (Ilorin, Nigeria) Library: 
262-66 

University of Iowa Libraries: 62-65 
Usage studies: 359-68 
"Use Studies: A Selective Review" 359-68 
"Using Verbal Reports to Understand Catalog- 
ing Expertise: Two Cases" 343-58 

V 

Verbal reports: 343-58 
Verona, Eva: 377-80 
Video recordings 

acquisition of: 294-96 (r) 

cataloging of: 294-96 (r) 

w 

Weihs, Jean: 294-96 (r) 

Weller, Marjorie S.: 113-32 

"What Users Really Think: How They See 

and Find Serials in the Arts and Sciences" 

49-60 

Whole Internet Catalog (Internet index): 275- 
86 

Workstations 

in technical services: 171-83 
World Wide Web 

subject access to: 275-86 
"The Worst of the Worst: Celebrating Twenty 

Years of the Worst Serial Title Change of 

the Year Award" 41-48 
Worst Serial Tide Change of the Year Award: 

43-48 

Wyly, Brendan J.: 211-36 
Y 

Yahoo (Internet index): 275-86 
Yale University Library: 67-77 

Z 

Z39.50 standard: 381-83 (r) 
Zhou, Peter: 62-65 
Zipp, Louise S.: 335-42 




wor 




You don't have to. No longer will your staff have 
to process, catalog, or prepare books for the shelf 
under tight budget constraints and shrinking 
resources. Just one call to Baker & Taylor and 
we'll do it all. Our librarians are experienced 
with providing cataloging and processing to meet 
your exact requirements and we can do it for less 
than it costs to do it yourself. Today there's a 
buzzword for it-" outsourcing." But at Baker & 
Taylor it's not new and it's not a buzzword-we've 
been providing shelf-ready books for almost 30 
years. In fact, our customers think of us as col- 
leagues-not just a book supplier So, why worry? 
Call Baker & Taylor. 

For more details about our selection, acquisition 
and technical services, please call Information 
Services at 1-800-775-1800. 
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• Plug & Play CD-ROM Networking 

• Compatible with All Major 
Operating Systems Jm 

• Choose 4X, 6X, or 8X CD-ROM Drives 

• Configurations from 4 to 39Z Drive Arrays 

• Remote Access Systems 

• Intranet Solutions P 

• CD Writers/Duplica 

• Partners with Majo 

• Available on GSA Contract 

• Toll Free Technical Support 

• One- Year Warranty 



TODD ENTERPRISES mc 

800-445-TODD 516-487-3976 FAX-516-466-6774 
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w OPTI-NET Direct 
This hardware-based solution 
provides shared CD-ROM 
access over your Ethernet 
network. Plug & Play and 
web server features. 
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Microsoft opti-xet 
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800-445-TODD 516-487-3976 
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Only Todd offers 
the Helping Hand... 

A FULL YEAR 

■ 

L SUPPORT 

/ today for a 
EE copy of our 
latest catalog! 



